Setting up software for data analysis (i.e. statistical computing) on OSX can be a major pain. I have a pretty clean, maintainable setup now, which perhaps merits sharing so that others can avoid spending as much time as I have setting things up. I will try to keep this updated so that it doesn't become one of the other 1000 setup posts that worked when it was written but is unworkable by the time some frustrated person finds it. Without further ado...
To give a general overview, I run all my command line software through homebrew rather than downloading binaries. I think it makes it much easier to keep software up to date. The specific tools I'll cover setting up are:
I've tried R-Studio (and it is generally quite nice). I think Emacs/ESS is better (for me at least) because you can navigate text faster, send commands to R faster, and, if you are so inclined, modify it to your heart's content. It also works works with just about every language there is, which is great if you use a variety of different tools.
The first thing to do is to install Apple's command line tools. You can do this one of two ways: install Xcode from the App Store, go to preferences, downloads, and then install the command line tools, or you can install them directly with the package provided by Apple (you'll need to set up an Apple developer account to do the latter). In OSX 10.9, you can install them from the command line with
xcode-select --install. Next you need to install XQuartz which is the replacement for
X11.app and (as you might be able to guess from the name) is a port (correct term?) of
X.org to OSX.
After the command line tools and XQuartz are installed we can get going with homebrew. To install homebrew (which requires Ruby of course), open Terminal.app (or whatever terminal emulator you might be using) and enter:
ruby -e "$(curl -fsSL https://raw.github.com/mxcl/homebrew/go)"
Now we can go ahead and start installing the base packages we need. Make sure we have the latest homebrew version (which we should), the latest formulas (also should), and that our system is setup correctly. You can check the dependencies of any particular formula with
brew deps <formula name>. You can see all of the available formulas on GitHub.
brew update && brew upgrade brew doctor #should say "Your system is ready to brew." # it used to say "Your system is raring to brew!" which is more excitng.
Before moving on to actually installing software, we should use it to make sure the
PATH environment variable is setup correctly. Specifically we want to make sure that
/usr/local/bin comes before
/usr/bin/ (this ensures that command line software that ships with your Mac is replaced by stuff in Homebrew if there are duplicates) and that the compilers and such we installed via the command line tools package (either from Xcode or from Apple directly) are available. Assuming you are using
bash (the default shell on OSX),
PATH is set in
/etc/paths. To see what is going on there open up
vim) from your home directory
sudo nano /etc/paths and add (and save) the following (if it doesn't look like this already).
/usr/local/bin /usr/bin /bin /usr/sbin /sbin
You'll need to restart your computer to refresh the
PATH. Now we can install some software. Hooray!
brew install git
Homebrew and Git should be good to go now.
First we need to install Emacs (the Apple supplied version is 22.1.1, which is old). I want the graphical version, but not the pre-built binaries from emacsformacosx, which, while nice, means you have to download a new binary every time Emacs updates (which, admittedly, is not super often).
brew install emacs --cocoa
Be sure to symlink Emacs to
/Applications if you want it to be accessible from the dock. The homebrew formula you just executed should spit out a nicely formatted symlink for you to execute, or you can use
First, check that the Emacs that is being pointed to in your PATH environment variable is the one installed by homebrew.
emacs --version #should be 24.3.1 or greater which emacs #should be /usr/local/bin/emacs
Go ahead and open the emacs and navigate to your
.emacs file, using
C-x C-f to open "find file" in the minibuffer. For the uninitiated,
C-x C-f is
open -a emacs
First, I set up the package management system, using the melpa, marmalade, and gnu package repositories. Since version 24, the package package has shipped with Emacs, so you shouldn't need to install it. Just add this to your
(require 'package) (setq package-archives '(("gnu" . "http://elpa.gnu.org/packages/") ("marmalade" . "http://marmalade-repo.org/packages/") ("melpa" . "http://melpa.milkbox.net/packages/"))) (package-initialize)
This will, by default, install packages to
~/.emacs.d/, so I add this folder (and its subfolders recursively) to my load-path.
(let ((default-directory "~/.emacs.d/")) (normal-top-level-add-to-load-path '(".")) (normal-top-level-add-subdirs-to-load-path))
You can either restart emacs after this, or just evaluate the buffer (
M is the
meta key on a Mac). Then type
M-x package-list and
package.el should fetch a list of the available packages listed in the repositories we listed. All you have to do to install a package is mark the package you want to install with
i (upgrades are marked using
u) and then execute all the installs with
The first thing to do is to make sure Emacs recognizes your environment variables correctly (particularly
$PATH). So first install the package
exec-path-from-shell and add the following to your
(require 'exec-path-from-shell) (when (memq window-system '(mac ns)) (exec-path-from-shell-initialize))
This will ensure that the problem the package author identifies (below) doesn't happen to you!
On OSX, an Emacs instance started from the graphical user interface will have a different environment than a shell in a terminal window, because OS X does not run a shell during the login. Obviously this will lead to unexpected results when calling external utilities like make from Emacs.
The basic ones I install for working with R, Python, Git, and LaTeX are ESS (Emacs Speaks Statistics, also on GitHub), AucTeX, Elpy (Emacs Python Development Environment), and Magit. All of which are quite awesome.
Magit doesn't require much configuration (or at least I don't use much). Adding the following to
.emacs should be enough to get you into trouble.
(require 'magit) (global-set-key (kbd "C-x g") 'magit-status)
For TeX I go with MacTeX but alternatively you can install BasicTeX and install packages as needed. It is a big file. After it is all installed add
/usr/texbin to your
PATH. Now we can set up AucTeX in Emacs. For my simple configuration (using XeLaTeX) just add the following to your
(load "auctex-pkg.el" nil t t) (setq TeX-engine 'xetex) ;if you prefer xetex that is, the default is pdftex (setq TeX-PDF-mode t)
Now when you open a
.tex file you should be able to compile it using XeLaTeX with a quick
To install R execute:
brew tap homebrew/science #the R formula has been moved here brew install r
Be sure to symlink
/Library/Frameworks, which is where R-Studio expects to find all your packages and such. Homebrew should give you a symlink to do this at the end of the install process.
If you have Bayesian tendencies it is worth noting that there is a
jags formula (though not a
stan formula quite yet). While R is installing we can set up ESS which is a great way to interact with the R interpreter. My ESS setup is relatively simple. You can do all sorts of fancy stuff with ESS later (this is Emacs after all).
;ess-mode configuration (setq ess-ask-for-ess-directory nil) (setq inferior-R-program-name "/usr/local/bin/R") (setq ess-local-process-name "R") (setq ansi-color-for-comint-mode 'filter) (setq comint-scroll-to-bottom-on-input t) (setq comint-scroll-to-bottom-on-output t) (setq comint-move-point-for-output t) (setq ess-eval-visibly-p nil) (require 'ess-site)
It is worth noting that there are a whole bunch of minor modes that I am not loading. You can find those in
revision is whatever revision of ESS happens to be current. Notably there are modes for JAGS and BUGS (a Stan major mode is also available through the package manager, though it isn't available in ESS at the moment).
Onwards to Python. Install Python (2.7.x) via homebrew (which obviates the need for a few hurdles such as
PYTHONPATH). Also you can install Python 3 this way (
brew install python3). Homebrew installs Python modules installed via
/usr/local/bin/ so you can delete everything in
/usr/local/share/python3 except for the symlinked
Extras folder if you please.
brew install python
Homebrew Python comes with
pip so we can do this:
pip install --upgrade distribute pip install --upgrade pip pip install conda
I manage all of "scientific" python packages using
conda rather than
easy_install. See here for a discussion of why that might be a good idea.
I defer to others on further details of setting up Emacs for proprer development in Python. Some good posts for that follow:
Anyways, I am sure you can use your Google-Fu to find plenty more.
brew tap staticfloat/julia brew install --HEAD --64bit julia
You can then link
julia from its home in
/usr/local/bin by setting the variable
inferior-julia-program-name in your
.emacs to the correct location.
Lastly here is a list of cool Emacs (and non-Emacs) stuff you might want to look at (that I didn't cover here)
(setq ispell-program-name "/usr/local/bin/aspell"))
(set-face-attribute 'default nil :foundry "apple" :family "Source Code Pro")
homebrew/sciencerepository, you'll need to
I have entirely too much of this stuff. It is truly a wonder I get anything done. Eventually I'll automate all this like a proper developer. me if I've made any mistakes (well obviously I've made some, but if you find them...) or any glaring ommissions. I'll see myself out.