bomquote/transistor

View on GitHub
Pin keyring to latest version 25.2.0 #653
pyup-bot authored 606da27c
complete00:00:48
1
git clone
2
codeclimate validate-config
View output
codeclimate validate-config
No errors or warnings found in .codeclimate.yml.
3
codeclimate prepare
View output
codeclimate prepare
4
builder pull-engines
View output
determining required images
docker pull codeclimate/codeclimate-radon:b695
b695: Pulling from codeclimate/codeclimate-radon
e00d546a75ad: Pulling fs layer
21f0a0866768: Pulling fs layer
cd9d3946aa16: Pulling fs layer
2e56add6654f: Pulling fs layer
6c87f215a2be: Pulling fs layer
c2b31566ca3d: Pulling fs layer
2e56add6654f: Waiting
6c87f215a2be: Waiting
c2b31566ca3d: Waiting
21f0a0866768: Verifying Checksum
21f0a0866768: Download complete
cd9d3946aa16: Download complete
e00d546a75ad: Verifying Checksum
e00d546a75ad: Download complete
e00d546a75ad: Pull complete
c2b31566ca3d: Verifying Checksum
c2b31566ca3d: Download complete
6c87f215a2be: Verifying Checksum
6c87f215a2be: Download complete
21f0a0866768: Pull complete
cd9d3946aa16: Pull complete
2e56add6654f: Verifying Checksum
2e56add6654f: Download complete
2e56add6654f: Pull complete
6c87f215a2be: Pull complete
c2b31566ca3d: Pull complete
Digest: sha256:dfeb7edc634b4e2f851f3c788f7c21bd8bae097d4c66af722c76a6ba51121f98
Status: Downloaded newer image for registry.prod.codeclimate.net/codeclimate/codeclimate-radon:b695
5
structure
View output
12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...
6
duplication
View output
12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...
I, [2024-04-26T17:45:19.778839 #1]  INFO -- : Skipping file ./examples/books_to_scrape/scraper.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 23
    def __init__(self, book_title: str, script=None, **kwargs):
                                 ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.781365 #1]  INFO -- : Skipping file ./examples/books_to_scrape/manager.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 39
    logger.info(f'spawning {target}')
                                   ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.790810 #1]  INFO -- : Skipping file ./examples/books_to_scrape/workgroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 47
    logger.info(f'Worker {self.name}-{self.number} created a new spider '
                                                                        ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.801935 #1]  INFO -- : Skipping file ./examples/books_to_scrape/persistence/serialization.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 29
    return f"UK {str(value)}"
                            ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.819907 #1]  INFO -- : Skipping file ./examples/books_to_scrape/settings.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 113
    NEWT_DB_URI = f"host=localhost port=5433 dbname=newtdb user={os.environ.get('PG_USER')} password={os.environ.get('PG_PW')}"
                                                                                                                              ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.827596 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/stateful_book/main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 133
    print(f"{r['book_title']}, {r['price']}, {r['stock']}")
                                                         ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.842558 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/brokers/worker_main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 140
    logger.info(f'Printing: books_scrape result =>')
                                                  ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.851836 #1]  INFO -- : Skipping file ./examples/books_to_scrape/schedulers/brokers/client_main.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 88
    logger.info(f'sent task {keyword_1}')
                                       ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.885468 #1]  INFO -- : Skipping file ./transistor/crawlers/splash_crawler_abc.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 183
    return f'<SplashScraper({self.name})>'
                                         ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.887791 #1]  INFO -- : Skipping file ./transistor/managers/base_manager.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 51
    def __init__(self, job_id, tasks: Type[Union[Type[StatefulBook],
                                    ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.900099 #1]  INFO -- : Skipping file transistor/utility/crawlera.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 28
    def get_crawlera_sessions(region:str):
                                    ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.931243 #1]  INFO -- : Skipping file transistor/utility/serialize.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 38
    return f"<{type(o).__name__}, {o.method}, {o.url}>"
                                                      ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.953541 #1]  INFO -- : Skipping file transistor/utility/utils.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 167
    print(f'Saved to {filepath}')
                               ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.959373 #1]  INFO -- : Skipping file ./transistor/browsers/splash_browser.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 317
    print(f'Timeout exception.')
                              ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:19.987441 #1]  INFO -- : Skipping file ./transistor/scrapers/splash_scraper_abc.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 54
    def __init__(self, script:str=None, **kwargs):
                             ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.021686 #1]  INFO -- : Skipping file ./transistor/persistence/newt_db/newt_crud.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 37
    def get_job_results(ndb, job_id:str=None):
                                   ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.022681 #1]  INFO -- : Skipping file ./transistor/persistence/exporters/base.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 104
    def serialize_field(self, field, name:str, value):
                                         ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.071328 #1]  INFO -- : Skipping file ./transistor/persistence/loader.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 39
    def serialize_field(field, name:str, value):
                                   ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.099817 #1]  INFO -- : Skipping file ./transistor/persistence/item.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 118
    class Item(DictItem, metaclass=ItemMeta):
                                  ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.125767 #1]  INFO -- : Skipping file ./transistor/workers/workgroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 45
    name: str
        ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.128932 #1]  INFO -- : Skipping file ./transistor/workers/basegroup.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 23
    def __init__(self, staff: int, job_id: str, timeout: tuple = None, **kwargs):
                            ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.140343 #1]  INFO -- : Skipping file ./transistor/workers/baseworker.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 26
    def __init__(self, job_id:str, spider, http_session=None, **kwargs):
                             ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.165885 #1]  INFO -- : Skipping file ./transistor/schedulers/brokers/queues.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 24
    def __init__(self, trackers: List[str], exchange_name: str='transistor',
                               ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.180162 #1]  INFO -- : Skipping file ./transistor/schedulers/books/bookstate.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 83
    def __init__(self, file_name: str=None, trackers: list=None, autorun=True,  **kwargs):
                                ^
SyntaxError: invalid syntax


I, [2024-04-26T17:45:20.193390 #1]  INFO -- : Skipping file ./transistor/schedulers/books/taskstate.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 87
    def __init__(self, name:str, to_do=None):
                           ^
SyntaxError: invalid syntax
7
csslint
csslint engine documentation
8
eslint
eslint engine documentation
View output
No rules are configured. Make sure you have added a config file with rules enabled.
See our documentation at https://docs.codeclimate.com/docs/eslint for more information.
(node:8) Warning: Accessing non-existent property 'cd' of module exports inside circular dependency
(Use `node --trace-warnings ...` to show where the warning was created)
(node:8) Warning: Accessing non-existent property 'pwd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'ls' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'find' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'cp' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'rm' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'mv' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'mkdir' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'test' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'cat' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'head' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'tail' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'to' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'toEnd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'sed' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'sort' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'uniq' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'grep' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'which' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'echo' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'dirs' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'pushd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'popd' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'ln' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'tempdir' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'exec' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'chmod' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'touch' of module exports inside circular dependency
(node:8) Warning: Accessing non-existent property 'set' of module exports inside circular dependency
9
fixme
fixme engine documentation
10
radon
radon engine documentation
View output
Running radon3...
11
pep8
pep8 engine documentation
View output
examples/ transistor/crawlers/ transistor/managers/ transistor/utility/crawlera.py transistor/utility/trackref.py transistor/utility/logging.py transistor/utility/conf.py transistor/utility/serialize.py transistor/utility/__init__.py transistor/utility/python.py transistor/utility/utils.py transistor/browsers/ transistor/scrapers/ transistor/headers.py transistor/persistence/ transistor/__init__.py transistor/_internal.py transistor/workers/ transistor/exceptions.py transistor/__version__.py transistor/schedulers/ appveyor/check_rabbitmq_connection.py setup.py img/
12
bandit
bandit engine documentation
View output
[main]	INFO	profile include tests: None
[main]	INFO	profile exclude tests: None
[main]	INFO	cli include tests: None
[main]	INFO	cli exclude tests: None
62 [0.. [node_visitor]	INFO	Unable to find qualified name for module: setup.py
50.. ]