The structure of my_dir is
├── README.md
├── main
│ ├── functions
│ │ ├── __pycache__
│ │ ├── my_function.py
│ ├── pipeline.py
│ ├── options
│ │ └── pipeline_options.py
│ └── transforms
│ ├── __pycache__
│ ├── my_transform.py
├── poetry.lock
├── pyproject.toml
└── tests
On pipeline.py:
from main.functions.my_function import MyFunction
On my_function.py:
import apache_beam as beam
class MyFunction(beam.DoFn):
...
I have read similar questions here, including this one which is the solution I have currently. Also read this on Python imports.
When I run pipeline.py, I get
Traceback (most recent call last):
File "pipeline.py", line 7, in <module>
from main.functions.my_function import MyFunction
ModuleNotFoundError: No module named 'main'
Additionally, I'm using VSCode and if I run the file via "Python: Run Python File in Terminal" I get back the error. However, if I run via the debugger the paths are all found and the error is not thrown, which I found odd. Also, VSCode isn't throwing any path warnings.
I know there are similar questions but I haven't been able to figure out what is wrong here and have spent quite some time on this already. Any help/pointer is much appreciated.
Additional info
- I'm using python 3.8.1
- Using
poetry run python main/pipeline.pyto run the code - Running from command from
my_dir