`<omp.h>`
First make sure you are using the correct compiler, i.e., GCC >= 4.7 from the GNU Project. For OS X, please follow the instruction here to download and install gcc-4.9. For Ubuntu, you can follow this link.
This link is very helpful.