endremborza/aswan

View on GitHub
reorganize for proc #155
Endre Márk Borza authored e2c6f378
complete00:00:16
Your first build completed successfully!

Congratulations

Your first build completed successfully!

See the Results

1
git clone
2
codeclimate validate-config
View output
codeclimate validate-config
No errors or warnings found in .codeclimate.json.
3
codeclimate prepare
View output
codeclimate prepare
4
builder pull-engines
View output
determining required images
5
structure
View output
12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...
6
duplication
View output
12
Parser process id: 12
codeclimate-parser socket not present
waiting 1s...
I, [2024-04-29T03:10:27.326470 #1]  INFO -- : Skipping file conftest.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 29
    self.app_address = f"http://localhost:{port_no}"
                                                   ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.350552 #1]  INFO -- : Skipping file aswan/object_store.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 32
    prefix_chars: int = 2,
                ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.357595 #1]  INFO -- : Skipping file aswan/connection_session.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 40
    event: CollEvent
         ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.363263 #1]  INFO -- : Skipping file aswan/security.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 18
    user: str
        ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.378089 #1]  INFO -- : Skipping file aswan/url_handler.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 24
    test_urls: Iterable[str] = []
             ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.378202 #1]  INFO -- : Skipping file aswan/project.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 24
    name: str,
        ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.401637 #1]  INFO -- : Skipping file aswan/metadata_handling.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 13
    def add_urls(session: Session, handler: str, urls: Iterable[str], overwrite=False):
                        ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.418924 #1]  INFO -- : Skipping file aswan/simplified_functions.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 10
    url: str, params: Optional[dict] = None, browser=False, headless=True, headers=None
       ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.431739 #1]  INFO -- : Skipping file aswan/utils.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 26
    browser: Chrome,
           ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.450207 #1]  INFO -- : Skipping file aswan/monitor_app.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 17
    def __init__(self, depot: AswanDepot, refresh_interval_secs=30):
                            ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.467573 #1]  INFO -- : Skipping file ./aswan/depot/remote.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 18
    def push(self, remote: Optional[str] = None):
                         ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.479593 #1]  INFO -- : Skipping file aswan/models.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 27
    return f"SourceURL: {self.handler}: {self.url} - {self.current_status}"
                                                                          ^
SyntaxError: invalid syntax


I, [2024-04-29T03:10:27.495653 #1]  INFO -- : Skipping file ./aswan/depot/base.py due to exception (CC::Engine::Analyzers::ParserError): `python2 /usr/src/app/lib/cc/engine/analyzers/python/parser.py` exited with code 1:
Traceback (most recent call last):
  File "/usr/src/app/lib/cc/engine/analyzers/python/parser.py", line 51, in <module>
    print(json.dumps(to_json(ast.parse(source))))
  File "/usr/local/python2/lib/python2.7/ast.py", line 37, in parse
    return compile(source, filename, mode, PyCF_ONLY_AST)
  File "<unknown>", line 42
    STATUS_DB_ZIP = f"db.{DB_KIND}.zip"
                                      ^
SyntaxError: invalid syntax
7
sonar-python
sonar-python engine documentation
View output
INFO: Java 1.8.0_111-internal Oracle Corporation (64-bit)
INFO: Linux 4.4.0-1128-aws amd64
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/src/app/build/libs/sonarlint-core-2.17.0.899.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/src/app/build/libs/sonarlint-cli-2.1.0.566.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [ch.qos.logback.classic.util.ContextSelectorStaticBinder]
INFO: Index files
INFO: 29 files indexed
ERROR: Unable to parse file: /code/conftest.py
ERROR: Parse error at line 30 column 21:

   26: port_no, verbose=True):
   27:         self.app_creator = app_creator
   28:         self._port_no = port_no
   29:         self.app_address = f"http://localhost:{port_no}"
  -->          self._process: Optional[Process] = None
   31:         self._verbose = verbose
   32: 
   33:     def start(self):
   34:         self._process = Process(target

ERROR: Unable to parse file: /code/aswan/connection_session.py
ERROR: Parse error at line 40 column 9:

   31: {
   32:     ConnectionError: Statuses.CONNECTION_ERROR,
   33:     BrokenSessionError: Statuses.SESSION_BROKEN,
   34: }
   35: DEFAULT_EXCEPTION_STATUS = Statuses.PARSING_ERROR
   36: 
   37: 
   38: @dataclass
   39: class UrlHandlerResult:
  -->      event: CollEvent
   41:     registered_links: list[RegEvent]
   42: 
   43: 
   44: @dataclass
   45: class HandlingTask:
   46:     handler: ANY_HANDLER_T
   47:     url: str
   48: 
   49:     def get_scheduler_task(

ERROR: Unable to parse file: /code/aswan/security.py
ERROR: Parse error at line 18 column 8:

    9: 
   10: from selenium import webdriver
   11: from selenium.webdriver import ChromeOptions
   12: 
   13: from .constants import CONFIG_PATH, ONE_YEAR
   14: 
   15: 
   16: @dataclass
   17: class ProxyAuth:
  -->      user: str
   19:     password: str
   20: 
   21: 
   22: class ProxyBase:
   23:     max_at_once = None
   24:     expiration_secs = ONE_YEAR
   25: 
   26:     prefix = "http"
   27:     port_no = 80
   28: 
   29:     def

ERROR: Unable to parse file: /code/aswan/project.py
ERROR: Parse error at line 40 column 25:

   37: .batch_size = max(int(self.max_cpu_use) * batch_multiplier, 40)
   38:         self.min_queue_size = self.batch_size // 2
   39: 
  -->          self._handler_dic: Dict[str, urh.ANY_HANDLER_T] = {}
   41:         self._scheduler: Optional[Scheduler] = None
   42:         self._monitor_app_process: Optional[

ERROR: Unable to parse file: /code/aswan/url_handler.py
ERROR: Parse error at line 24 column 13:

   15: .utils import add_url_params
   16: 
   17: if TYPE_CHECKING:
   18:     from selenium.webdriver import Chrome                    
   19: 
   20: logger = get_logger()
   21: 
   22: 
   23: class UrlHandlerBase:
  -->      test_urls: Iterable[str] = []
   25:     url_root: Optional[str] = None
   26:     proxy_cls: Type[ProxyBase] = DEFAULT_PROXY
   27: 
   28:     max_in_parallel: Optional

ERROR: Unable to parse file: /code/aswan/models.py
ERROR: Parse error at line 32 column 7:

   24: .UniqueConstraint(url, handler)
   25: 
   26:     def __repr__(self):
   27:         return f"SourceURL: {self.handler}: {self.url} - {self.current_status}"
   28: 
   29: 
   30: @dataclass
   31: class _Event:
  -->      url: str
   33:     handler: str
   34:     _read_fun: Callable[..., bytes] = field(default=None, init=False)
   35:     _extended

ERROR: Unable to parse file: /code/aswan/depot/remote.py
ERROR: Parse error at line 134 column 15:

  129: list[str]:
  130:         import invoke
  131: 
  132:         local_posix = dir_path.relative_to(self.root).as_posix()
  133:         try:
  -->              _ls: list[str] = conn.run(f"ls {local_posix}", hide=True).stdout.split()
  135:         except invoke.UnexpectedExit:
  136: 

ERROR: Unable to parse file: /code/aswan/depot/base.py
ERROR: Parse error at line 82 column 10:

   77: __path).write_text(yaml.dump(asdict(self)))
   78: 
   79: 
   80: @dataclass
   81: class Status(_DepotObj):
  -->      parent: Optional[str] = None
   83:     integrated_runs: list[str] = field(default_factory=list)
   84: 
   85:     @property
   86:     def name(self)

INFO: ------------------------------------------------------------------------
INFO: EXECUTION SUCCESS
INFO: ------------------------------------------------------------------------
INFO: Total time: 0.555s
INFO: Final Memory: 6M/295M
INFO: ------------------------------------------------------------------------