IlyaGusev/rulm

View on GitHub

Showing 204 of 260 total issues

Avoid too many return statements within this function.
Open

        return None
Severity: Major
Found in data_processing/create_habr.py - About 30 mins to fix

    Avoid too many return statements within this function.
    Open

        return {
    Severity: Major
    Found in data_processing/create_habr.py - About 30 mins to fix

      Avoid too many return statements within this function.
      Open

          return text
      Severity: Major
      Found in data_processing/create_librusec.py - About 30 mins to fix

        Avoid too many return statements within this function.
        Open

                return
        Severity: Major
        Found in data_processing/save_mc4.py - About 30 mins to fix

          Avoid too many return statements within this function.
          Open

              return processed_comments
          Severity: Major
          Found in data_processing/create_habr.py - About 30 mins to fix

            Avoid too many return statements within this function.
            Open

                    return
            Severity: Major
            Found in data_processing/save_mc4.py - About 30 mins to fix

              Avoid too many return statements within this function.
              Open

                      return text
              Severity: Major
              Found in data_processing/util.py - About 30 mins to fix

                Avoid too many return statements within this function.
                Open

                                return
                Severity: Major
                Found in data_processing/save_mc4.py - About 30 mins to fix

                  Avoid too many return statements within this function.
                  Open

                                  return
                  Severity: Major
                  Found in data_processing/save_mc4.py - About 30 mins to fix

                    Avoid too many return statements within this function.
                    Open

                        return text
                    Severity: Major
                    Found in data_processing/save_mc4.py - About 30 mins to fix

                      Avoid too many return statements within this function.
                      Open

                                      return
                      Severity: Major
                      Found in data_processing/save_mc4.py - About 30 mins to fix

                        Function filter_claude has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def filter_claude(
                            input_path: str,
                            output_path: str,
                            model_name: str = "claude-3-opus-20240229"
                        ):
                        Severity: Minor
                        Found in self_instruct/src/data_processing/filter_claude.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function __init__ has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                            def __init__(
                                self,
                                original_records: List[Dict],
                                tokenizer: AutoTokenizer,
                                max_tokens_count: int,
                        Severity: Minor
                        Found in self_instruct/src/train_reward.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function get_muserc has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def get_muserc(split):
                            dataset = load_dataset(HF_DATASET, "muserc", split=split)
                            for row in dataset:
                                record = {
                                    "task": "muserc",
                        Severity: Minor
                        Found in self_instruct/src/data_processing/convert_rsg.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function interact has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def interact(
                            model_path,
                            n_ctx=8192,
                            top_k=30,
                            top_p=0.9,
                        Severity: Minor
                        Found in self_instruct/src/interact_llama3_llamacpp.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function sample_record has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                            def sample_record(self, username, retries=300, max_overlap=3):
                                found_new = False
                                for _ in range(retries):
                                    record = sysrand.choice(self.records)
                                    instruction = record["instruction"]
                        Severity: Minor
                        Found in self_instruct/src/bot/run_sbs.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function interact has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def interact(
                            model_path,
                            n_ctx=2000,
                            top_k=30,
                            top_p=0.9,
                        Severity: Minor
                        Found in self_instruct/src/interact_mistral_llamacpp.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function aggregate has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def aggregate(records, overlap=5, min_agreement=0.0):
                            results = defaultdict(list)
                            records.sort(key=lambda x: x["assignment_id"])
                            for r in records:
                                results[get_key(r)].append(r["result"])
                        Severity: Minor
                        Found in self_instruct/crowd/aggregate.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function get_rucos has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def get_rucos(split, sample_rate: float = 0.05):
                            dataset = load_dataset(HF_DATASET, "rucos", split=split)
                            for row in dataset:
                                if split != "test" and random.random() > sample_rate:
                                    continue
                        Severity: Minor
                        Found in self_instruct/src/data_processing/convert_rsg.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Function get_danetqa has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.
                        Open

                        def get_danetqa(split):
                            dataset = load_dataset(HF_DATASET, "danetqa", split=split)
                            for row in dataset:
                                record = {
                                    "task": "parus",
                        Severity: Minor
                        Found in self_instruct/src/data_processing/convert_rsg.py - About 25 mins to fix

                        Cognitive Complexity

                        Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                        A method's cognitive complexity is based on a few simple rules:

                        • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                        • Code is considered more complex for each "break in the linear flow of the code"
                        • Code is considered more complex when "flow breaking structures are nested"

                        Further reading

                        Severity
                        Category
                        Status
                        Source
                        Language