Issues - unb-cic-esw/facebook-page-post-scraper

File `page_scraper.py` has 363 lines of code (exceeds 250 allowed). Consider refactoring.
Open

"""@page_scraper Responsavel por definir Scraper e seus metodos."""
 
import os
import json
import csv

Found in scraper/page_scraper.py - About 4 hrs to fix

Function `get_reactions` has a Cognitive Complexity of 26 (exceeds 5 allowed). Consider refactoring.
Open

    def get_reactions(self, page=None, since_date=None, until_date=None):
        """Raspa informações da página referentes a reações."""
        if page is None:
            page = self.page
        if not self.valid_page(page):

Found in scraper/page_scraper.py - About 3 hrs to fix

Read up
Read up

Cyclomatic complexity is too high in method get_reactions. (15)
Open

    def get_reactions(self, page=None, since_date=None, until_date=None):
        """Raspa informações da página referentes a reações."""
        if page is None:
            page = self.page
        if not self.valid_page(page):

Found in scraper/page_scraper.py by radon

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Cyclomatic complexity is too high in method write_to_csv. (11)
Open

    def write_to_csv(self, file_name='scraped'):
        """Grava informações da página raspada em um arquivo CSV."""
 
        def dict_to_list():
            content = []

Found in scraper/page_scraper.py by radon

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Cyclomatic complexity is too high in method scrape_current_page. (6)
Open

    def scrape_current_page(self, page=None, feed=False, query=''):
        """Raspa dados de uma página selecionada."""
        if page is not None:
            self.set_page(page)
        graph = facebook.GraphAPI(access_token=self.token, version="2.12")

Found in scraper/page_scraper.py by radon

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Cyclomatic complexity is too high in function update_token_file. (6)
Open

def update_token_file(file='config.ini', **kwargs):
    """Atualiza o token no arquivo config.ini."""
    config = ConfigParser()
    config.read(path + file)

Found in scraper/token_manager.py by radon

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Function `write_to_csv` has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring.
Open

    def write_to_csv(self, file_name='scraped'):
        """Grava informações da página raspada em um arquivo CSV."""
 
        def dict_to_list():
            content = []

Found in scraper/page_scraper.py - About 1 hr to fix

Read up
Read up

Similar blocks of code found in 2 locations. Consider refactoring.
Open

        num_comments = 0 if 'comments' not in status else \
            status['comments']['summary']['total_count']

Found in scraper/page_scraper.py and 1 other location - About 45 mins to fix

Read up
Read up

scraper/page_scraper.py on lines 194..195

Similar blocks of code found in 2 locations. Consider refactoring.
Open

        num_reactions = 0 if 'reactions' not in status else \
            status['reactions']['summary']['total_count']

Found in scraper/page_scraper.py and 1 other location - About 45 mins to fix

Read up
Read up

scraper/page_scraper.py on lines 196..197

Fenced code blocks should be surrounded by blank lines
Open

```

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

First header should be a top level header
Open

### Detalhes

Found in .github/PULL_REQUEST_TEMPLATE.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Fenced code blocks should be surrounded by blank lines
Open

```

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Trailing spaces
Open

Uma vez com o ChromeDriver instalado corretamente, é necessário setar uma variável de ambiente da

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Line length
Open

Para rodar os testes localmente, use `make` se você estiver no Mac ou Linux com Make instalado.

Found in .github/PULL_REQUEST_TEMPLATE.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Trailing spaces
Open

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Line length
Open

* [ ] Você acrescentou uma explicação sobre suas mudanças e o por que você acha que devemos incluí-las?

Found in .github/PULL_REQUEST_TEMPLATE.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Line length
Open

seguinte forma: utilizando um editor de texto, vá em venv/bin/activate e, logo abaixo de deactivate()

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Trailing spaces
Open

```

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Fenced code blocks should be surrounded by blank lines
Open

```

Found in README.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

First header should be a top level header
Open

## 1. Description of the bug

Found in .github/ISSUE_TEMPLATE/bug_report.md by markdownlint

Read up
Read up
Exclude checks
- Disable engine
- Disable check

Construct	Effect on CC	Reasoning
if	+1	An if statement is a single decision.
elif	+1	The elif statement adds another decision.
else	+0	The else statement does not cause a new decision. The decision is at the if.
for	+1	There is a decision at the start of the loop.
while	+1	There is a decision at the while statement.
except	+1	Each except branch adds a new conditional path of execution.
finally	+0	The finally block is unconditionally executed.
with	+1	The with statement roughly corresponds to a try/except block (see PEP 343 for details).
assert	+1	The assert statement internally roughly equals a conditional statement.
Comprehension	+1	A list/set/dict comprehension of generator expression is equivalent to a for loop.
Boolean Operator	+1	Every boolean operator (and, or) adds a decision point.

Construct	Effect on CC	Reasoning
if	+1	An if statement is a single decision.
elif	+1	The elif statement adds another decision.
else	+0	The else statement does not cause a new decision. The decision is at the if.
for	+1	There is a decision at the start of the loop.
while	+1	There is a decision at the while statement.
except	+1	Each except branch adds a new conditional path of execution.
finally	+0	The finally block is unconditionally executed.
with	+1	The with statement roughly corresponds to a try/except block (see PEP 343 for details).
assert	+1	The assert statement internally roughly equals a conditional statement.
Comprehension	+1	A list/set/dict comprehension of generator expression is equivalent to a for loop.
Boolean Operator	+1	Every boolean operator (and, or) adds a decision point.

Construct	Effect on CC	Reasoning
if	+1	An if statement is a single decision.
elif	+1	The elif statement adds another decision.
else	+0	The else statement does not cause a new decision. The decision is at the if.
for	+1	There is a decision at the start of the loop.
while	+1	There is a decision at the while statement.
except	+1	Each except branch adds a new conditional path of execution.
finally	+0	The finally block is unconditionally executed.
with	+1	The with statement roughly corresponds to a try/except block (see PEP 343 for details).
assert	+1	The assert statement internally roughly equals a conditional statement.
Comprehension	+1	A list/set/dict comprehension of generator expression is equivalent to a for loop.
Boolean Operator	+1	Every boolean operator (and, or) adds a decision point.

Construct	Effect on CC	Reasoning
if	+1	An if statement is a single decision.
elif	+1	The elif statement adds another decision.
else	+0	The else statement does not cause a new decision. The decision is at the if.
for	+1	There is a decision at the start of the loop.
while	+1	There is a decision at the while statement.
except	+1	Each except branch adds a new conditional path of execution.
finally	+0	The finally block is unconditionally executed.
with	+1	The with statement roughly corresponds to a try/except block (see PEP 343 for details).
assert	+1	The assert statement internally roughly equals a conditional statement.
Comprehension	+1	A list/set/dict comprehension of generator expression is equivalent to a for loop.
Boolean Operator	+1	Every boolean operator (and, or) adds a decision point.

unb-cic-esw/facebook-page-post-scraper

Showing 34 of 38 total issues

File page_scraper.py has 363 lines of code (exceeds 250 allowed). Consider refactoring. Open

Function get_reactions has a Cognitive Complexity of 26 (exceeds 5 allowed). Consider refactoring. Open

Cyclomatic complexity is too high in method get_reactions. (15) Open

Cyclomatic complexity is too high in method write_to_csv. (11) Open

Cyclomatic complexity is too high in method scrape_current_page. (6) Open

Cyclomatic complexity is too high in function update_token_file. (6) Open

Function write_to_csv has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring. Open

Similar blocks of code found in 2 locations. Consider refactoring. Open

Similar blocks of code found in 2 locations. Consider refactoring. Open

Fenced code blocks should be surrounded by blank lines Open

First header should be a top level header Open

Fenced code blocks should be surrounded by blank lines Open

Trailing spaces Open

Line length Open

Trailing spaces Open

Line length Open

Line length Open

Trailing spaces Open

Fenced code blocks should be surrounded by blank lines Open

First header should be a top level header Open

Severity

Category

Status

Source

Language

Cognitive Complexity

A method's cognitive complexity is based on a few simple rules:

Further reading

Cyclomatic Complexity

Cyclomatic Complexity

Cyclomatic Complexity

Cyclomatic Complexity

Cognitive Complexity

A method's cognitive complexity is based on a few simple rules:

Further reading

Duplicated Code

Tuning

Refactorings

Further Reading

Duplicated Code

Tuning

Refactorings

Further Reading

MD031 - Fenced code blocks should be surrounded by blank lines

MD002 - First header should be a top level header

MD031 - Fenced code blocks should be surrounded by blank lines

MD009 - Trailing spaces

MD013 - Line length

MD009 - Trailing spaces

MD013 - Line length

MD013 - Line length

MD009 - Trailing spaces

MD031 - Fenced code blocks should be surrounded by blank lines

MD002 - First header should be a top level header

File `page_scraper.py` has 363 lines of code (exceeds 250 allowed). Consider refactoring.
Open

Function `get_reactions` has a Cognitive Complexity of 26 (exceeds 5 allowed). Consider refactoring.
Open

Cyclomatic complexity is too high in method get_reactions. (15)
Open

Cyclomatic complexity is too high in method write_to_csv. (11)
Open

Cyclomatic complexity is too high in method scrape_current_page. (6)
Open

Cyclomatic complexity is too high in function update_token_file. (6)
Open

Function `write_to_csv` has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring.
Open

Similar blocks of code found in 2 locations. Consider refactoring.
Open

Similar blocks of code found in 2 locations. Consider refactoring.
Open

Fenced code blocks should be surrounded by blank lines
Open

First header should be a top level header
Open

Fenced code blocks should be surrounded by blank lines
Open

Trailing spaces
Open

Line length
Open

Trailing spaces
Open

Line length
Open

Line length
Open

Trailing spaces
Open

Fenced code blocks should be surrounded by blank lines
Open

First header should be a top level header
Open