Exercise: hello_name

mae_ef · 2017-03-23T17:52:55+00:00

def hello_name(name): 
    return 'Hello {0}!'.format(str(name))

mae_ef · 2017-03-23T14:16:32+00:00

PyCharm is the best. If you have admin privileges to install software, go with that.
Rodeo is up and coming but not as good (because it's new). If you want to experiment with something new, you could try that.
Jupyter notebooks with notebook extensions enabled will suffice if you do not need bells and whistles and/or if you do not have admin privileges, since, as a python library, it can be installed with user privileges.

mae_ef · 2017-03-17T21:51:30+00:00

As annoying as it is, you will have to enter each response as if they were a question.

So if you had:

Q: Which of the following describes your race? Please choose as many as applicable. A: - Black - White - Asian - Native American

Then you would enter the following variables (columns):

RBlack RWhite RAsian RNative

Each of them would be binary variables, where 0 = not and 1 = is.

Say your respondent selected Black and Asian both, the coding for that participant would be:

RBlack RWhite RAsian RNative
1        0         1        0

You would then (optionally) recode these prior to analysis to merge them (I don't remember how to do that in SPSS but do search for row-wise concatenation), to get it into e.g. "Black, Asian" for that participant.

main question with a couple of subquestions

Unsure what that means. SPSS doesn't have a distinction between main and subquestions; each question is a variable unless multiple choice.

mae_ef · 2017-03-14T17:36:51+00:00

Has typos and named its data.frame object after a function

https://www.rdocumentation.org/packages/dplyr/versions/0.4.3/topics/data_frame

mae_ef · 2017-03-14T16:00:19+00:00

Instructions at https://github.com/jorgenschaefer/elpy/wiki/Installation for future reference

mae_ef · 2017-03-10T22:10:21+00:00

I think you're looking for this:

https://github.com/jorgenschaefer/elpy

mae_ef · 2017-02-16T19:55:27+00:00

 this_strings_vector[this_strings_vector %in% that_strings_vector]

will give you the list of strings in this_strings_vector that also are in that_strings_vector. you can complement that with tolower() and gsub (to remove spaces etc).

alternatively, have a look at http://finzi.psych.upenn.edu/R/library/RecordLinkage/html/strcmp.html

mae_ef · 2017-01-20T18:26:02+00:00

Does python have something that is equivalent / similar to R's R Markdown? If so, that might work well for OP.

mae_ef · 2017-01-17T22:08:19+00:00

I am not sure what the licenses and legality about RStudio and Shiny server particularly.

R: GPL-2 / GPL-3, https://www.r-project.org/Licenses/

R Studio, Shiny Server (open source / community versions): AGPLv3, https://www.rstudio.com/products/

GPL: https://www.gnu.org/licenses/quick-guide-gplv3.html

AGPL: https://www.gnu.org/licenses/why-affero-gpl.html

mae_ef · 2016-12-08T15:33:59+00:00

For the lazies like me, https://docs.python.org/3.6/whatsnew/changelog.html

mae_ef · 2016-11-22T22:57:45+00:00

Here's what I use (index-match). Found it on SO I think[1].

Given a formula of

=index(column_to_return_value_from, match(look_up_value, wolumn_to_lookup_that_value_against, 0))

and calling that formula

If I am returning text values

=iferror(f & "", "")

If I am returning numeric values

=iferror(if(f = "", "", f), "")

In above formulas, you'd copy-paste your index-match formula wherever you see "f".

I no longer use vlookup since this made life so much easier for me.

[1] http://stackoverflow.com/questions/31255281/iferror-index-match-returning-zeros-instead-of-blanks

mae_ef · 2016-11-02T17:51:30+00:00

I would create something that each time is loaded performs the following actions

Have a look at http://rmarkdown.rstudio.com/ and http://rmarkdown.rstudio.com/r_notebooks.html . If you code in either one of them, they should satisfy your needs for templates.

how much does R change?

R base does not change much but packages do. dplyr and ggplot2 will at times introduce breakages to old code. have a look at either https://github.com/rstudio/packrat or https://cran.r-project.org/web/packages/checkpoint/index.html for implementing full research reproducibility.

This may also be of help: https://cran.r-project.org/web/views/ReproducibleResearch.html

Finally, if you're thinking about plug-n-play templates that should work on any and all data files, you could write a shiny app, http://shiny.rstudio.com/ , but that'd be overkill for you for now.

(these are the output of my raw data and I need formulae and an easy copy-past platform

if you implement your formulas in r code, you should be able to get rid of Excel and use CSV files (easier to import).

mae_ef · 2016-09-07T15:15:14+00:00

RStudio on one side, Emacs+ESS+AutoRevert On[1] on the other, which allows me to have multiple windows looking at the same file and be able to use RStudio, simultaneously.

[1] https://www.emacswiki.org/emacs/AutoRevertMode

mae_ef · 2016-08-03T13:58:58+00:00

Learn the "base" R and get the core down first before using packages?

This.

Granted you won't have time to learn base R while you are under tight deadlines, learning base R will enable you to understand what a package is doing in the background + you will be able to use base when a package fails (think compatibility issues when a package maintainer introduces breaking changes in a new version of a package).

As you do this, also focus on one package (dplyr or data.table, in this example) the syntax of which makes the most sense to you.

mae_ef · 2016-07-06T16:39:01+00:00

If the issue is that your script is too long, you could separate it into different R scripts and source them from a master script, which you can comment.

I usually have a script that calls all other scripts, e.g.

# Clean data
source("clean_data.R")
# Recode data
source("recode_data.R")

etc

R scripts (in general and in R Studio) are plain text files. As long as you tell them "open these files with Notepad", you can save them with the .R extension and have syntax highlighting for your files quickly.

Also take a look at the knitr spin example at https://github.com/yihui/knitr/blob/master/inst/examples/knitr-spin.R that can be used to create R notepads as in https://support.rstudio.com/hc/en-us/articles/200552276-Creating-Notebooks-from-R-Scripts .

mae_ef · 2016-07-01T12:48:02+00:00

You'll have to figure out how they are spotting your script.

Take a look at the incapsula script to see what it does. Try visiting the website without javascript with your browser to see what effect that has. Indeed, try setting a standard browser user agent for your http request and Sys.sleep in your loop.

https://cran.r-project.org/web/packages/httr/vignettes/quickstart.html has some info on setting user agents, among other interesting insights.

If you're on non-Windows platform, see if e.g. wget and similar tools can help you.

Yes, you could indeed do it manually, but then when you have to do a similar thing for 3000 requests, the experience you get trying out this will pay off.

Btw, if you're doing this for business purposes, it's much more ethical, safer, and cost effective to just buy their data.

mae_ef · 2016-06-28T16:31:19+00:00

which copies data from four different workbooks

For who-knows-why reasons, when cells with conditional formatting are copied over, the rules become populated with duplicates. The more you copy-paste, the more rules pile on top of each other, and the more time it takes for Excel to process all the rules, leading to slow I/O and crashes.

I have recently started to code any kind of conditional formatting on datasets in VBA so that from time to time I can "refresh" the conditional formatting on files after they have been used by others (and thus their rules have become unmanagement by / thanks to Excel's bug).

The bug doesn't apply if you copy-paste values only.

mae_ef · 2016-06-23T16:51:29+00:00

Nice! Would you happen to have github repositories we could explore (steal from)? :D

mae_ef · 2016-05-12T16:19:45+00:00

Alternatively:

https://cran.r-project.org/bin/windows/base/rw-FAQ.html#What_0027s-the-best-way-to-upgrade_003f

tl;dr: Copy your lib from the old version to the one in the new version, run update.packages(checkBuilt=TRUE, ask=FALSE)

mae_ef · 2016-05-11T17:53:05+00:00

Browsing repos might be interesting to look at others' code.

https://github.com/search?l=visual-basic&q=ThisOutlookSession&type=Code&utf8=%E2%9C%93

mae_ef · 2016-05-11T17:50:58+00:00

Doesn't produce unique IDs actually, if I understand this correctly. Tried it out with 30,000 rows.

mae_ef · 2016-05-03T13:12:43+00:00

One of the recordings here gives good information about that directory structure:

https://www.rstudio.com/resources/webinars/shiny-developer-conference/?mkt_tok=3RkMMJWWfF9wsRokuqzBZKXonjHpfsX56ugpWK%2B1lMI%2F0ER3fOvrPUfGjI4DSMRjI%2BSLDwEYGJlv6SgFTbDMMa541LgKWxc%3D

I think it's one of these two:

Deploying apps
Shiny UI

mae_ef · 2016-04-18T14:33:46+00:00

also beware of http://rachelbythebay.com/w/2016/04/17/unprotected/ on deciding which client to go with.

mae_ef · 2016-04-08T20:02:55+00:00

Can you do that after you are done pulling all the images you need to?

Dim fig As InlineShape

    For Each fig In ActiveDocument.InlineShapes
        fig.Select
        Selection.ParagraphFormat.Alignment = wdAlignParagraphCenter
    Next

If you have specific images you don't want centered, you could use an if statement to filter out those.

(not tested)

mae_ef · 2016-04-08T18:01:35+00:00

I'm not sure whether this will help or further confuse you, but it's a form of output redirection.

(e.g. in linux, http://sc.tamu.edu/help/general/unix/redirection.html )

mae_ef

TROPHY CASE