bomquote/transistor

codeclimate validate-config
No errors or warnings found in .codeclimate.yml.

codeclimate prepare

determining required images

12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...

12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...
I, [2024-05-04T18:12:52.421196 #1]  INFO -- : Skipping file ./examples/books_to_scrape/manager.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 39
    logger.info(f'spawning {target}')
                                   ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.424939 #1]  INFO -- : Skipping file ./examples/books_to_scrape/scraper.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 23
    def __init__(self, book_title: str, script=None, **kwargs):
                                 ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.432264 #1]  INFO -- : Skipping file ./examples/books_to_scrape/workgroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 47
    logger.info(f'Worker {self.name}-{self.number} created a new spider '
                                                                        ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.443176 #1]  INFO -- : Skipping file ./examples/books_to_scrape/persistence/serialization.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 29
    return f"UK {str(value)}"
                            ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.459992 #1]  INFO -- : Skipping file ./examples/books_to_scrape/settings.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 113
    NEWT_DB_URI = f"host=localhost port=5433 dbname=newtdb user={os.environ.get('PG_USER')} password={os.environ.get('PG_PW')}"
                                                                                                                              ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.465407 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/stateful_book/main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 133
    print(f"{r['book_title']}, {r['price']}, {r['stock']}")
                                                         ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.481947 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/brokers/worker_main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 140
    logger.info(f'Printing: books_scrape result =>')
                                                  ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.487279 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/brokers/client_main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 88
    logger.info(f'sent task {keyword_1}')
                                       ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.523676 #1]  INFO -- : Skipping file ./transistor/crawlers/splash_crawler_abc.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 183
    return f'<SplashScraper({self.name})>'
                                         ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.524208 #1]  INFO -- : Skipping file ./transistor/managers/base_manager.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 51
    def __init__(self, job_id, tasks: Type[Union[Type[StatefulBook],
                                    ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.535336 #1]  INFO -- : Skipping file transistor/utility/crawlera.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 28
    def get_crawlera_sessions(region:str):
                                    ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.563187 #1]  INFO -- : Skipping file transistor/utility/serialize.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 38
    return f"<{type(o).__name__}, {o.method}, {o.url}>"
                                                      ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.582178 #1]  INFO -- : Skipping file transistor/utility/utils.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 167
    print(f'Saved to {filepath}')
                               ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.589817 #1]  INFO -- : Skipping file ./transistor/browsers/splash_browser.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 317
    print(f'Timeout exception.')
                              ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.610401 #1]  INFO -- : Skipping file ./transistor/scrapers/splash_scraper_abc.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 54
    def __init__(self, script:str=None, **kwargs):
                             ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.641039 #1]  INFO -- : Skipping file ./transistor/persistence/newt_db/newt_crud.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 37
    def get_job_results(ndb, job_id:str=None):
                                   ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.645934 #1]  INFO -- : Skipping file ./transistor/persistence/exporters/base.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 104
    def serialize_field(self, field, name:str, value):
                                         ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.703193 #1]  INFO -- : Skipping file ./transistor/persistence/loader.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 39
    def serialize_field(field, name:str, value):
                                   ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.714827 #1]  INFO -- : Skipping file ./transistor/persistence/item.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 118
    class Item(DictItem, metaclass=ItemMeta):
                                  ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.742594 #1]  INFO -- : Skipping file ./transistor/workers/basegroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 23
    def __init__(self, staff: int, job_id: str, timeout: tuple = None, **kwargs):
                            ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.751004 #1]  INFO -- : Skipping file ./transistor/workers/workgroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 45
    name: str
        ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.753574 #1]  INFO -- : Skipping file ./transistor/workers/baseworker.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 26
    def __init__(self, job_id:str, spider, http_session=None, **kwargs):
                             ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.785074 #1]  INFO -- : Skipping file ./transistor/schedulers/brokers/queues.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 24
    def __init__(self, trackers: List[str], exchange_name: str='transistor',
                               ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.796081 #1]  INFO -- : Skipping file ./transistor/schedulers/books/bookstate.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 83
    def __init__(self, file_name: str=None, trackers: list=None, autorun=True,  **kwargs):
                                ^
SyntaxError: invalid syntax


I, [2024-05-04T18:12:52.798683 #1]  INFO -- : Skipping file ./transistor/schedulers/books/taskstate.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 87
    def __init__(self, name:str, to_do=None):
                           ^
SyntaxError: invalid syntax

No rules are configured. Make sure you have added a config file with rules enabled.
See our documentation at https://docs.codeclimate.com/docs/eslint for more information.
(node:8) Warning: Accessing non-existent property 'cd' of module exports inside circular dependency
(Use `node --trace-warnings ...` to show where the warning was created)
(node:8) Warning: Accessing non-existent property 'pwd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'ls' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'find' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'cp' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'rm' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'mv' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'mkdir' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'test' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'cat' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'head' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'tail' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'to' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'toEnd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'sed' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'sort' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'uniq' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'grep' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'which' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'echo' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'dirs' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'pushd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'popd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'ln' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'tempdir' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'exec' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'chmod' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'touch' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'set' of module exports inside circular dependency

Running radon3...

examples/ transistor/crawlers/ transistor/managers/ transistor/utility/crawlera.py transistor/utility/trackref.py transistor/utility/logging.py transistor/utility/conf.py transistor/utility/serialize.py transistor/utility/__init__.py transistor/utility/python.py transistor/utility/utils.py transistor/browsers/ transistor/scrapers/ transistor/headers.py transistor/persistence/ transistor/__init__.py transistor/_internal.py transistor/workers/ transistor/exceptions.py transistor/__version__.py transistor/schedulers/ appveyor/check_rabbitmq_connection.py setup.py img/

[main]	INFO	profile include tests: None
[main]	INFO	profile exclude tests: None
[main]	INFO	cli include tests: None
[main]	INFO	cli exclude tests: None
62 [0.. [node_visitor]	INFO	Unable to find qualified name for module: setup.py
50.. ]