File repository.py has 518 lines of code (exceeds 250 allowed). Consider refactoring.

Open

from configparser import RawConfigParser
from binascii import hexlify
from itertools import islice
import errno
import os

Function check has a Cognitive Complexity of 42 (exceeds 5 allowed). Consider refactoring.

Open

    def check(self, repair=False):
        """Check repository consistency

        This method verifies all segment checksums and makes sure
        the index is consistent with the data stored in the segments.

• Read up
  Read up

Function replay_segments has a Cognitive Complexity of 24 (exceeds 5 allowed). Consider refactoring.

Open

    def replay_segments(self, index_transaction_id, segments_transaction_id):
        self.prepare_txn(index_transaction_id, do_cleanup=False)
        for segment, filename in self.io.segment_iterator():
            if index_transaction_id is not None and segment <= index_transaction_id:
                continue

• Read up
  Read up

Function compact_segments has a Cognitive Complexity of 19 (exceeds 5 allowed). Consider refactoring.

Open

    def compact_segments(self):
        """Compact sparse segments by copying data into new segments
        """
        if not self.compact:
            return

• Read up
  Read up

Repository has 22 functions (exceeds 20 allowed). Consider refactoring.

Open

class Repository(object):
    """Filesystem based transactional key value store

    On disk layout:
    dir/README

Function iter_objects has a Cognitive Complexity of 13 (exceeds 5 allowed). Consider refactoring.

Open

    def iter_objects(self, segment, include_data=False):
        fd = self.get_fd(segment)
        fd.seek(0)
        if fd.read(8) != MAGIC:
            raise IntegrityError('Invalid segment header')

• Read up
  Read up

Avoid deeply nested control flow statements.

Open

                        if index_transaction_id is None or segment > index_transaction_id:
                            self.io.write_delete(key)
                assert segments[segment] == 0

Function get_write_fd has a Cognitive Complexity of 8 (exceeds 5 allowed). Consider refactoring.

Open

    def get_write_fd(self, no_new=False):
        if not no_new and self.offset and self.offset > self.limit:
            self.close_segment()
        if not self._write_fd:
            if self.segment % self.segments_per_dir == 0:

• Read up
  Read up

Function prepare_txn has a Cognitive Complexity of 7 (exceeds 5 allowed). Consider refactoring.

Open

    def prepare_txn(self, transaction_id, do_cleanup=True):
        self._active_txn = True
        self.lock.upgrade()
        if not self.index:
            self.index = self.open_index(transaction_id)

• Read up
  Read up

Function read has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.

Open

    def read(self, segment, offset, id):
        if segment == self.segment and self._write_fd:
            self._write_fd.flush()
        fd = self.get_fd(segment)
        fd.seek(offset)

• Read up
  Read up

Function recover_segment has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.

Open

    def recover_segment(self, segment, filename):
        self.fds.pop(segment).close()
        # FIXME: save a copy of the original file
        with open(filename, 'rb') as fd:
            data = memoryview(fd.read())

• Read up
  Read up

Function write_index has a Cognitive Complexity of 6 (exceeds 5 allowed). Consider refactoring.

Open

    def write_index(self):
        hints = {b'version': 1,
                 b'segments': self.segments,
                 b'compact': list(self.compact)}
        transaction_id = self.io.get_segments_transaction_id()

• Read up
  Read up