1
0
mirror of https://github.com/arsenetar/dupeguru.git synced 2024-12-21 10:59:03 +00:00
Go to file
Andrew Senetar 51b18d4c84
Switch file hashing to xxhash instead of md5
- Improves performance significantly in some cases
- Add xxhash to requirements.txt and sort requirements
- Rename md5 based members to digest
- Update all tests to use new member names and hashing methods
- Update hash db code to upgrade schema

NOTE: May consider supporting multiple hashing algorithms in the future.
2022-03-25 23:13:12 -05:00
.github Add workflow yml validation settings 2022-03-21 22:18:22 -05:00
.tx Update transifex config & pull latest updates 2022-03-19 20:21:14 -05:00
.vscode Add vscode extension recommendation 2022-03-21 22:27:16 -05:00
core Switch file hashing to xxhash instead of md5 2022-03-25 23:13:12 -05:00
help Fix help path for local files and some help doc updates 2022-03-19 17:43:11 -05:00
hscommon Fix deprecation warning from sqlite 2022-03-19 17:01:53 -05:00
images Update for macos Qt version 2020-12-30 16:44:27 -06:00
locale Update transifex config & pull latest updates 2022-03-19 20:21:14 -05:00
pkg Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00
qt Fix help path for local files and some help doc updates 2022-03-19 17:43:11 -05:00
qtlib Update transifex config & pull latest updates 2022-03-19 20:21:14 -05:00
.ctags Add ctags config 2016-06-07 21:36:25 -04:00
.gitignore Add vscode extension recommendation 2022-03-21 22:27:16 -05:00
.sonarcloud.properties Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00
build.py Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00
CONTRIBUTING.md Fix internal links in CONTRIBUTING.md 2022-03-21 22:19:58 -05:00
CREDITS Remove icon credits from about box 2020-10-28 02:18:41 +01:00
LICENSE Change license from BSD to GPLv3 2015-01-04 09:59:08 -05:00
macos.md Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00
Makefile Update min python version in Makefile 2022-03-20 01:23:01 -05:00
MANIFEST.in Updates to setup files 2021-08-25 04:10:38 -05:00
package.py Fix macOS packaging issue 2022-02-09 22:33:41 -06:00
pyproject.toml Add configuration for isort to pyproject.toml 2022-03-21 00:25:36 -05:00
README.md Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00
requirements-extra.txt Removing travis 2021-08-17 18:16:20 -05:00
requirements.txt Switch file hashing to xxhash instead of md5 2022-03-25 23:13:12 -05:00
run.py First pass code cleanup in qt/qtlib 2021-08-24 00:12:23 -05:00
setup.cfg Move polib to setup_requires instead of install_requires 2022-03-20 22:48:03 -05:00
setup.nsi Enforce minimum Windows version ref #983 2022-03-19 17:01:54 -05:00
setup.py Minor Updates 2021-08-26 03:29:24 -05:00
tox.ini Add Python 3.10 to tox.ini 2022-01-25 10:39:52 -06:00
win_version_info.temp Update Windows Build 2019-03-24 21:35:34 -05:00
Windows.md Drop Python 3.6 Support 2022-03-15 05:10:41 -05:00

dupeGuru

dupeGuru is a cross-platform (Linux, OS X, Windows) GUI tool to find duplicate files in a system. It is written mostly in Python 3 and has the peculiarity of using multiple GUI toolkits, all using the same core Python code. On OS X, the UI layer is written in Objective-C and uses Cocoa. On Linux, it is written in Python and uses Qt5.

The Cocoa UI of dupeGuru is hosted in a separate repo: https://github.com/arsenetar/dupeguru-cocoa

Current status

Still looking for additional help especially with regards to:

  • OSX maintenance: reproducing bugs & cocoa version, building package with Cocoa UI.
  • Linux maintenance: reproducing bugs, maintaining PPA repository, Debian package.
  • Translations: updating missing strings, transifex project at https://www.transifex.com/voltaicideas/dupeguru-1
  • Documentation: keeping it up-to-date.

Contents of this folder

This folder contains the source for dupeGuru. Its documentation is in help, but is also available online in its built form. Here's how this source tree is organized:

  • core: Contains the core logic code for dupeGuru. It's Python code.
  • qt: UI code for the Qt toolkit. It's written in Python and uses PyQt.
  • images: Images used by the different UI codebases.
  • pkg: Skeleton files required to create different packages
  • help: Help document, written for Sphinx.
  • locale: .po files for localization.
  • hscommon: A collection of helpers used across HS applications.
  • qtlib: A collection of helpers used across Qt UI codebases of HS applications.

How to build dupeGuru from source

Windows & macOS specific additional instructions

For windows instructions see the Windows Instructions.

For macos instructions (qt version) see the macOS Instructions.

Prerequisites

System Setup

When running in a linux based environment the following system packages or equivalents are needed to build:

  • python3-pyqt5
  • pyqt5-dev-tools (on some systems, see note)
  • python3-wheel (for hsaudiotag3k)
  • python3-venv (only if using a virtual environment)
  • python3-dev
  • build-essential

Note: On some linux systems pyrcc5 is not put on the path when installing python3-pyqt5, this will cause some issues with the resource files (and icons). These systems should have a respective pyqt5-dev-tools package, which should also be installed. The presence of pyrcc5 can be checked with which pyrcc5. Debian based systems need the extra package, and Arch does not.

To create packages the following are also needed:

  • python3-setuptools
  • debhelper

Building with Make

dupeGuru comes with a makefile that can be used to build and run:

$ make && make run

Building without Make

$ cd <dupeGuru directory>
$ python3 -m venv --system-site-packages ./env
$ source ./env/bin/activate
$ pip install -r requirements.txt
$ python build.py
$ python run.py

Generating Debian/Ubuntu package

To generate packages the extra requirements in requirements-extra.txt must be installed, the steps are as follows:

$ cd <dupeGuru directory>
$ python3 -m venv --system-site-packages ./env
$ source ./env/bin/activate
$ pip install -r requirements.txt -r requirements-extra.txt
$ python build.py --clean
$ python package.py

This can be made a one-liner (once in the directory) as:

$ bash -c "python3 -m venv --system-site-packages env && source env/bin/activate && pip install -r requirements.txt -r requirements-extra.txt && python build.py --clean && python package.py"

Running tests

The complete test suite is run with Tox 1.7+. If you have it installed system-wide, you don't even need to set up a virtualenv. Just cd into the root project folder and run tox.

If you don't have Tox system-wide, install it in your virtualenv with pip install tox and then run tox.

You can also run automated tests without Tox. Extra requirements for running tests are in requirements-extra.txt. So, you can do pip install -r requirements-extra.txt inside your virtualenv and then py.test core hscommon