Unable to run Airflow 1.10 on Mac OS

Question

The latest version of Airflow 1.10 requires some setup for the logger.

I carefully followed the instructions and created a config folder with airflow/config_templates/airflow_local_settings.py and added it to PYTHONPATH.

Unfortunately when running airflow I get this error:

ValueError: Unable to configure handler 'processor':
  Cannot resolve 'airflow.utils.log.file_processor_handler.FileProcessorHandler': 
    dlopen(/Users/arikliber/miniconda3/envs/py36-6/lib/python3.6/site-packages/psutil/_psutil_osx.cpython-36m-darwin.so, 2):
      Symbol not found: ___CFConstantStringClassReference
  Referenced from: /Users/arikliber/miniconda3/envs/py36-6/lib/python3.6/site-packages/psutil/_psutil_osx.cpython-36m-darwin.so
  Expected in: flat namespace
    in /Users/arikliber/miniconda3/envs/py36-6/lib/python3.6/site-packages/psutil/_psutil_osx.cpython-36m-darwin.so

Everything was installed on a fresh miniconda environment.

Anyone got Airflow 1.10 on a Mac OS (I have 10.13.6) and mind sharing the workflow?

Answer 1

I used the brew installation of python 3.6, a venv from -m venv and installed airflow v 1.10 by checking out the source at branch v1-10-stable and installing with pip -e <path/to/apache-airflow-src-dir>/ After installing I used pip check to find that click 7.0 had been installed by flask but that flask-appbuilder didn't like that, so I had to unstall that and install click 6.7. You could try and modify the setup.py to put flask-appbuilder before flask in the ordered requirements.