Showing 12 of 14 total issues
File wiki_link.py
has 380 lines of code (exceeds 250 allowed). Consider refactoring. Open
#!/usr/bin/env python
# -*- coding: utf-8 -*-
"""Provide Wikilink- Main class of the project"""
Function _single_threaded_scraper
has a Cognitive Complexity of 25 (exceeds 5 allowed). Consider refactoring. Open
def _single_threaded_scraper(self):
""" Return minimum number of link using single threaded scraper
Args:
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"
Further reading
Function _worker
has a Cognitive Complexity of 17 (exceeds 5 allowed). Consider refactoring. Open
def _worker(self, execution_queue, storage_queue, separation_queue, event):
""" The worker function that pick up url_id from
execution_queue and scrape
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"
Further reading
Function _delegator
has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring. Open
def _delegator(self,
execution_queue,
storage_queue,
separation_queue,
event,
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"
Further reading
Avoid deeply nested control flow statements. Open
if n.to_page_id not in visited_set:
visited_set.add(n.to_page_id)
queue.appendleft(n.to_page_id)
Avoid deeply nested control flow statements. Open
if n.to_page_id == self.dest_id:
return number_of_separation
Function _scraper
has a Cognitive Complexity of 8 (exceeds 5 allowed). Consider refactoring. Open
def _scraper(session, url_id):
""" Scrap urls from given url id and insert into database
Args:
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"
Further reading
Function setup_db
has 5 arguments (exceeds 4 allowed). Consider refactoring. Open
def setup_db(self, db, name, password, ip="127.0.0.1", port="3306"):
Function __init__
has 5 arguments (exceeds 4 allowed). Consider refactoring. Open
def __init__(self, db, name, password, ip, port):
Function _delegator
has 5 arguments (exceeds 4 allowed). Consider refactoring. Open
def _delegator(self,
Function _multiprocessing_scraper
has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring. Open
def _multiprocessing_scraper(self):
""" Return minimum number of link using single multiprocessing scraper
Args:
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"
Further reading
Function __init__
has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring. Open
def __init__(self, db, name, password, ip, port):
if db == "postgresql":
connection = "postgresql+psycopg2://" + name + ":" \
+ password + "@" + ip + ":" + port
- Read upRead up
Cognitive Complexity
Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.
A method's cognitive complexity is based on a few simple rules:
- Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
- Code is considered more complex for each "break in the linear flow of the code"
- Code is considered more complex when "flow breaking structures are nested"