HazyResearch/fonduer

View on GitHub

Showing 134 of 224 total issues

Function upsert_keys has a Cognitive Complexity of 13 (exceeds 5 allowed). Consider refactoring.
Open

    def upsert_keys(
        self,
        keys: Iterable[Union[str, Callable]],
        candidate_classes: Optional[
            Union[Type[Candidate], List[Type[Candidate]]]
Severity: Minor
Found in src/fonduer/supervision/labeler.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function _preprocess_visual_features has a Cognitive Complexity of 13 (exceeds 5 allowed). Consider refactoring.
Open

def _preprocess_visual_features(doc: Document) -> None:
    if hasattr(doc, "_visual_features"):
        return
    # cache flag
    doc._visual_features = True
Severity: Minor
Found in src/fonduer/utils/data_model_utils/visual.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function get_sparse_matrix has a Cognitive Complexity of 13 (exceeds 5 allowed). Consider refactoring.
Open

def get_sparse_matrix(
    session: Session,
    key_table: Table,
    cand_lists: Union[Sequence[Candidate], Iterable[Sequence[Candidate]]],
    key: Optional[str] = None,
Severity: Minor
Found in src/fonduer/utils/utils_udf.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function drop_keys has a Cognitive Complexity of 13 (exceeds 5 allowed). Consider refactoring.
Open

    def drop_keys(
        self,
        keys: Iterable[Union[str, Callable]],
        candidate_classes: Optional[
            Union[Type[Candidate], List[Type[Candidate]]]
Severity: Minor
Found in src/fonduer/supervision/labeler.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function corenlp_to_xmltree has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring.
Open

def corenlp_to_xmltree(obj: Union[Dict, Sentence], prune_root: bool = True) -> XMLTree:
    """Convert CoreNLP attributes into an XMLTree.

    Transform an object with CoreNLP dep_path and dep_parent attributes into
    an XMLTree. Will include elements of any array having the same dimension
Severity: Minor
Found in src/fonduer/features/feature_libs/tree_structs.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function save_marginals has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring.
Open

def save_marginals(
    session: Session, X: List[Candidate], marginals: Session, training: bool = True
) -> None:
    """Save marginal probabilities for a set of Candidates to db.

Severity: Minor
Found in src/fonduer/learning/utils.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function drop_keys has a Cognitive Complexity of 12 (exceeds 5 allowed). Consider refactoring.
Open

def drop_keys(session: Session, key_table: Table, keys: Dict) -> None:
    """Bulk drop annotation keys to the specified table.

    Rather than directly dropping the keys, this removes the candidate_classes
    specified for the given keys only. If all candidate_classes are removed for
Severity: Minor
Found in src/fonduer/utils/utils_udf.py - About 1 hr to fix

Cognitive Complexity

Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

A method's cognitive complexity is based on a few simple rules:

  • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
  • Code is considered more complex for each "break in the linear flow of the code"
  • Code is considered more complex when "flow breaking structures are nested"

Further reading

Function __init__ has 11 arguments (exceeds 4 allowed). Consider refactoring.
Open

    def __init__(
Severity: Major
Found in src/fonduer/parser/parser.py - About 1 hr to fix

    Function _parse_file has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
    Open

        def _parse_file(self, fp: str, file_name: str) -> Iterator[Document]:
            name = os.path.basename(fp)[: os.path.basename(fp).rfind(".")]
            with codecs.open(fp, encoding=self.encoding) as f:
                reader = csv.reader(f)
    
    
    Severity: Minor
    Found in src/fonduer/parser/preprocessors/csv_doc_preprocessor.py - About 1 hr to fix

    Cognitive Complexity

    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

    A method's cognitive complexity is based on a few simple rules:

    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
    • Code is considered more complex for each "break in the linear flow of the code"
    • Code is considered more complex when "flow breaking structures are nested"

    Further reading

    Function apply has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
    Open

        def apply(self, doc: Document, **kwargs: Any) -> Document:
            """Extract mentions from the given Document.
    
            :param doc: A document to process.
            """
    Severity: Minor
    Found in src/fonduer/candidates/mentions.py - About 1 hr to fix

    Cognitive Complexity

    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

    A method's cognitive complexity is based on a few simple rules:

    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
    • Code is considered more complex for each "break in the linear flow of the code"
    • Code is considered more complex when "flow breaking structures are nested"

    Further reading

    Function apply has 9 arguments (exceeds 4 allowed). Consider refactoring.
    Open

        def apply(  # type: ignore
    Severity: Major
    Found in src/fonduer/supervision/labeler.py - About 1 hr to fix

      Function _convert_mappings_to_matrix has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring.
      Open

      def _convert_mappings_to_matrix(
          mappings: List[Dict[str, Any]], keys: List[str]
      ) -> csr_matrix:
          """Convert a list of (annotation) mapping into a sparse matrix.
      
      
      Severity: Minor
      Found in src/fonduer/utils/utils_udf.py - About 1 hr to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function get_mapping has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.
      Open

      def get_mapping(
          table: Table,
          candidates: Iterable[Candidate],
          generator: Callable[[Candidate], Iterator[Tuple]],
      ) -> Iterator[Dict[str, Any]]:
      Severity: Minor
      Found in src/fonduer/utils/utils_udf.py - About 55 mins to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function drop_all_keys has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.
      Open

      def drop_all_keys(
          session: Session, key_table: Table, candidate_classes: Iterable[Type[Candidate]]
      ) -> None:
          """Bulk drop annotation keys for all the candidate_classes in the table.
      
      
      Severity: Minor
      Found in src/fonduer/utils/utils_udf.py - About 55 mins to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function drop_keys has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.
      Open

          def drop_keys(
              self,
              keys: Iterable[str],
              candidate_classes: Union[Candidate, Iterable[Candidate], None] = None,
          ) -> None:
      Severity: Minor
      Found in src/fonduer/features/featurizer.py - About 55 mins to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function upsert_keys has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.
      Open

          def upsert_keys(
              self,
              keys: Iterable[str],
              candidate_classes: Union[Candidate, Iterable[Candidate], None] = None,
          ) -> None:
      Severity: Minor
      Found in src/fonduer/features/featurizer.py - About 55 mins to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function __init__ has a Cognitive Complexity of 9 (exceeds 5 allowed). Consider refactoring.
      Open

          def __init__(
              self,
              structural: bool,
              blacklist: Union[str, List[str]],
              flatten: Union[str, List[str]],
      Severity: Minor
      Found in src/fonduer/parser/parser.py - About 55 mins to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function apply has 7 arguments (exceeds 4 allowed). Consider refactoring.
      Open

          def apply(  # type: ignore
      Severity: Major
      Found in src/fonduer/features/featurizer.py - About 50 mins to fix

        Function _get_direction_ngrams has 7 arguments (exceeds 4 allowed). Consider refactoring.
        Open

        def _get_direction_ngrams(
        Severity: Major
        Found in src/fonduer/utils/data_model_utils/visual.py - About 50 mins to fix

          Function get_neighbor_cell_ngrams has 7 arguments (exceeds 4 allowed). Consider refactoring.
          Open

          def get_neighbor_cell_ngrams(
          Severity: Major
          Found in src/fonduer/utils/data_model_utils/tabular.py - About 50 mins to fix
            Severity
            Category
            Status
            Source
            Language