Sign upLogin

IlyaGusev/rulm

View on GitHub
Star

Showing 204 of 260 total issues

Function generate_instructions has 10 arguments (exceeds 4 allowed). Consider refactoring.
Open

def generate_instructions(
Severity: Major
Found in self_instruct/src/data_processing/generate_instructions.py - About 1 hr to fix

    Function main has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
    Open

    def main(
    chars_path,
    output_path,
    template_path,
    model_name="gpt-4",
    Severity: Minor
    Found in self_instruct/src/data_processing/generate_char_image_prompts.py - About 1 hr to fix

    Cognitive Complexity

    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

    A method's cognitive complexity is based on a few simple rules:

    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
    • Code is considered more complex for each "break in the linear flow of the code"
    • Code is considered more complex when "flow breaking structures are nested"

    Further reading

    Function evolve_batch has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
    Open

    def evolve_batch(
    original_tasks,
    model_name,
    decoding_args,
    depth_template_path: str = None,
    Severity: Minor
    Found in self_instruct/src/data_processing/improve_instructions.py - About 1 hr to fix

    Cognitive Complexity

    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

    A method's cognitive complexity is based on a few simple rules:

    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
    • Code is considered more complex for each "break in the linear flow of the code"
    • Code is considered more complex when "flow breaking structures are nested"

    Further reading

    Function annotate_meta_claude has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
    Open

    def annotate_meta_claude(
    input_path: str,
    output_path: str,
    model_name: str = "claude-3-sonnet-20240229"
):
    Severity: Minor
    Found in self_instruct/src/data_processing/annotate_meta_claude.py - About 1 hr to fix

    Cognitive Complexity

    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

    A method's cognitive complexity is based on a few simple rules:

    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
    • Code is considered more complex for each "break in the linear flow of the code"
    • Code is considered more complex when "flow breaking structures are nested"

    Further reading

    Function generate_chars has 10 arguments (exceeds 4 allowed). Consider refactoring.
    Open

    def generate_chars(
    Severity: Major
    Found in self_instruct/src/data_processing/generate_chars.py - About 1 hr to fix

      Function main has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
      Open

      def main(
    input_path,
    seed,
    token,
    existing_markup_path,
      Severity: Minor
      Found in self_instruct/crowd/upload.py - About 1 hr to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function load_saiga has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
      Open

      def load_saiga(
    model_name: str,
    use_8bit: bool = False,
    use_4bit: bool = False,
    torch_compile: bool = False,
      Severity: Minor
      Found in self_instruct/src/util/load.py - About 1 hr to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function convert_record has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
      Open

          def convert_record(self, record):
        conversation = Conversation.from_template(self.templates_path)
        conversation.expand(record["messages"])

        input_ids, labels = [], []
      Severity: Minor
      Found in self_instruct/src/dataset.py - About 1 hr to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function parse_comments has a Cognitive Complexity of 11 (exceeds 5 allowed). Consider refactoring.
      Open

      def parse_comments(post_id):
    api_url = "https://habr.com/kek/v2/articles/{}/comments".format(post_id)
    try:
        r = requests.get(api_url)
        if r.status_code == 503:
      Severity: Minor
      Found in data_processing/create_habr.py - About 1 hr to fix

      Cognitive Complexity

      Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

      A method's cognitive complexity is based on a few simple rules:

      • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
      • Code is considered more complex for each "break in the linear flow of the code"
      • Code is considered more complex when "flow breaking structures are nested"

      Further reading

      Function aggregate has 31 lines of code (exceeds 25 allowed). Consider refactoring.
      Open

      def aggregate(records, overlap=5, min_agreement=0.0):
    results = defaultdict(list)
    records.sort(key=lambda x: x["assignment_id"])
    for r in records:
        results[get_key(r)].append(r["result"])
      Severity: Minor
      Found in self_instruct/crowd/aggregate.py - About 1 hr to fix

        Function infer has 9 arguments (exceeds 4 allowed). Consider refactoring.
        Open

        def infer(
        Severity: Major
        Found in self_instruct/src/infer_saiga_llamacpp.py - About 1 hr to fix

          Function train has 9 arguments (exceeds 4 allowed). Consider refactoring.
          Open

          def train(
          Severity: Major
          Found in self_instruct/src/train.py - About 1 hr to fix

            Function infer_saiga_vllm has 9 arguments (exceeds 4 allowed). Consider refactoring.
            Open

            def infer_saiga_vllm(
            Severity: Major
            Found in self_instruct/src/infer_saiga_vllm.py - About 1 hr to fix

              Function evolve_batch has 9 arguments (exceeds 4 allowed). Consider refactoring.
              Open

              def evolve_batch(
              Severity: Major
              Found in self_instruct/src/data_processing/improve_instructions.py - About 1 hr to fix

                Function generate_answers has 9 arguments (exceeds 4 allowed). Consider refactoring.
                Open

                def generate_answers(
                Severity: Major
                Found in self_instruct/src/infer_saiga.py - About 1 hr to fix

                  Function check_complete has 28 lines of code (exceeds 25 allowed). Consider refactoring.
                  Open

                      def check_complete(self, a_attribs):
        assert a_attribs is not None
        parent_id = a_attribs["ParentId"]
        parent = self.questions[parent_id]
        if parent is None:
                  Severity: Minor
                  Found in data_processing/create_stackoverflow.py - About 1 hr to fix

                    Function main has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring.
                    Open

                    def main(
    seeds_path,
    output_path,
    template_path,
    model_name="gpt-3.5-turbo",
                    Severity: Minor
                    Found in self_instruct/src/data_processing/generate_chat.py - About 1 hr to fix

                    Cognitive Complexity

                    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                    A method's cognitive complexity is based on a few simple rules:

                    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                    • Code is considered more complex for each "break in the linear flow of the code"
                    • Code is considered more complex when "flow breaking structures are nested"

                    Further reading

                    Function main has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring.
                    Open

                    def main(
    input_path,
    output_path,
    template_path,
    model_name="gpt-3.5-turbo",
                    Severity: Minor
                    Found in self_instruct/src/data_processing/exec_instructions.py - About 1 hr to fix

                    Cognitive Complexity

                    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                    A method's cognitive complexity is based on a few simple rules:

                    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                    • Code is considered more complex for each "break in the linear flow of the code"
                    • Code is considered more complex when "flow breaking structures are nested"

                    Further reading

                    Function _save_checkpoint has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring.
                    Open

                        def _save_checkpoint(self, model, trial, metrics=None):
        print("Running custom _save_checkpoint")
        checkpoint_folder = f"{PREFIX_CHECKPOINT_DIR}-{self.state.global_step}"
        run_dir = self._get_output_dir(trial=trial)
        output_dir = os.path.join(run_dir, checkpoint_folder)
                    Severity: Minor
                    Found in self_instruct/src/train.py - About 1 hr to fix

                    Cognitive Complexity

                    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                    A method's cognitive complexity is based on a few simple rules:

                    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                    • Code is considered more complex for each "break in the linear flow of the code"
                    • Code is considered more complex when "flow breaking structures are nested"

                    Further reading

                    Function fix_output_records has a Cognitive Complexity of 10 (exceeds 5 allowed). Consider refactoring.
                    Open

                    def fix_output_records(records):
    for char in records:
        unique_dialogues = dict()
        topics = char["topics"]
        if "dialogues" in char:
                    Severity: Minor
                    Found in self_instruct/src/data_processing/generate_char_chats.py - About 1 hr to fix

                    Cognitive Complexity

                    Cognitive Complexity is a measure of how difficult a unit of code is to intuitively understand. Unlike Cyclomatic Complexity, which determines how difficult your code will be to test, Cognitive Complexity tells you how difficult your code will be to read and comprehend.

                    A method's cognitive complexity is based on a few simple rules:

                    • Code is not considered more complex when it uses shorthand that the language provides for collapsing multiple statements into one
                    • Code is considered more complex for each "break in the linear flow of the code"
                    • Code is considered more complex when "flow breaking structures are nested"

                    Further reading

                    Severity
                    Category
                    Status
                    Source
                    Language