python – ぷすぅ～ぷすぅ～

github Actions で、自動試験を workflow で記載してる時にModuleNotFoundError: No module named でなかなか前に進めなかった時の備忘録。

ちょっとディレクリ構成が複雑で

target/
├── src/
│   ├── xxxx.py
│   └── yyyy.py
├── resources/
│   └── setting.yml
├── others/
│   └── test_zzzz.py
└── tests/
    ├── test_xxxx.py
    ├── unit_utils.py
    └── resources/
        └── setting.yml

target/

├── src/

│ ├── xxxx.py

│ └── yyyy.py

├── resources/

│ └── setting.yml

├── others/

│ └── test_zzzz.py

└── tests/

├── test_xxxx.py

├── unit_utils.py

└── resources/

└── setting.yml

project がソースディレクトリで、others には自動試験には不要な試験が。
また、testsの中では、tests内部で参照される unit_utils.pyがあって。
あと、ソース内では、設定ファイルが本番と試験で参照箇所が違っていて、ソース内部からは相対パスで見てます。

なので、target ディレクトリ

poetrty run pytest

poetrty run pytest

とすると、ModuleNotFoundError が出る。さらに、unit_utils.py もうまく参照できない。

とありあえず正解は、

      - name: Set env
        run: echo "PYTHONPATH=../src" >> $GITHUB_ENV
      - name: Run test
        run: |
          cd tests
          poetry run python -m pytest

- name: Set env

run: echo "PYTHONPATH=../src" >> $GITHUB_ENV

- name: Run test

run: |

cd tests

poetry run python -m pytest

Set env で、 PYTHONPATH に srcディレクトリを追加。(cd で後で移動するので一つ上の階層）
試験実行時には、tests ディレクトリに移動。これにより、othersにある試験を無視。
poetry run python -m pytest で実行する。

proxy 経由のネットワーク環境で、あるpython モジュールをインストールしたら以下のエラー

    ERROR: Command errored out with exit status 1:
     command: /usr/local/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hSxJgS/pycef/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hSxJgS/pycef/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-hSxJgS/pycef/pip-egg-info
         cwd: /tmp/pip-install-hSxJgS/pycef/
    Complete output (17 lines):
    Download error on https://pypi.org/simple/pytest-runner/: [Errno 104] Connection reset by peer -- Some packages may not be found!
    Couldn't find index page for 'pytest-runner' (maybe misspelled?)
    Download error on https://pypi.org/simple/: [Errno 104] Connection reset by peer -- Some packages may not be found!
    No local packages or working download links found for pytest-runner
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/tmp/pip-install-hSxJgS/pycef/setup.py", line 27, in <module>
        "License :: OSI Approved :: MIT License"
      File "build/bdist.linux-x86_64/egg/setuptools/__init__.py", line 128, in setup
      File "build/bdist.linux-x86_64/egg/setuptools/__init__.py", line 123, in _install_setup_requires
      File "build/bdist.linux-x86_64/egg/setuptools/dist.py", line 514, in fetch_build_eggs
      File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 770, in resolve
      File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1053, in best_match
      File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1065, in obtain
      File "build/bdist.linux-x86_64/egg/setuptools/dist.py", line 581, in fetch_build_egg
      File "build/bdist.linux-x86_64/egg/setuptools/command/easy_install.py", line 667, in easy_install
    distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('pytest-runner')
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

ERROR: Command errored out with exit status 1:

command: /usr/local/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-hSxJgS/pycef/setup.py'"'"'; __file__='"'"'/tmp/pip-install-hSxJgS/pycef/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-install-hSxJgS/pycef/pip-egg-info

cwd: /tmp/pip-install-hSxJgS/pycef/

Complete output (17 lines):

Download error on https://pypi.org/simple/pytest-runner/: [Errno 104] Connection reset by peer -- Some packages may not be found!

Couldn't find index page for 'pytest-runner' (maybe misspelled?)

Download error on https://pypi.org/simple/: [Errno 104] Connection reset by peer -- Some packages may not be found!

No local packages or working download links found for pytest-runner

Traceback (most recent call last):

File "<string>", line 1, in <module>

File "/tmp/pip-install-hSxJgS/pycef/setup.py", line 27, in <module>

"License :: OSI Approved :: MIT License"

File "build/bdist.linux-x86_64/egg/setuptools/__init__.py", line 128, in setup

File "build/bdist.linux-x86_64/egg/setuptools/__init__.py", line 123, in _install_setup_requires

File "build/bdist.linux-x86_64/egg/setuptools/dist.py", line 514, in fetch_build_eggs

File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 770, in resolve

File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1053, in best_match

File "build/bdist.linux-x86_64/egg/pkg_resources/__init__.py", line 1065, in obtain

File "build/bdist.linux-x86_64/egg/setuptools/dist.py", line 581, in fetch_build_egg

File "build/bdist.linux-x86_64/egg/setuptools/command/easy_install.py", line 667, in easy_install

distutils.errors.DistutilsError: Could not find suitable distribution for Requirement.parse('pytest-runner')

----------------------------------------

ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

setup.py の setup_requires pytest-runner が入っているんだけど、それが取ってこれないみたい。

setup_requires を処理するときは、pip で指定した –proxy の指定引き継がれてないのか。

install_requires を処理すときは、–proxy の宛先を引き継いでるっぽい。

とりあえず、別途 pytest-runner を pip でインストールして解決した。

カテゴリー: python

[python + github workflow] ModuleNotFoundError: No module named エラー

[python] pip で、proxy経由でイントール失敗 [Errno 104]