1.5 - 1.6 - 1.7 - 1.8 | Repomix stuck in processing repo

[peperunas]

Description

Hello! First of all, great work.

I am working on MacOS on a private repository. Whatever the version of Repomix (starting from 1.5), I cannot get a summary whatever the arguments I use:

$ git ls-files | npx repomix@latest --stdin --verbose                                                                              devenv-shell-env
directories: [ '.' ]
cwd: /Users/giulio/dev/paperone
options: {
  fileSummary: true,
  directoryStructure: true,
  files: true,
  gitSortByChanges: true,
  gitignore: true,
  defaultPatterns: true,
  securityCheck: true,
  stdin: true,
  verbose: true
}
Loaded CLI options: {
  fileSummary: true,
  directoryStructure: true,
  files: true,
  gitSortByChanges: true,
  gitignore: true,
  defaultPatterns: true,
  securityCheck: true,
  stdin: true,
  verbose: true
}
No Repopack files found to migrate.
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.ts
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.mts
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.cts
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.js
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.mjs
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.cjs
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.json5
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.jsonc
Checking for local config at: /Users/giulio/dev/paperone/repomix.config.json
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.ts
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.mts
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.cts
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.js
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.mjs
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.cjs
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.json5
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.jsonc
Checking for global config at: /Users/giulio/.config/repomix/repomix.config.json
No custom config found at repomix.config.ts, repomix.config.mts, repomix.config.cts, repomix.config.js, repomix.config.mjs, repomix.config.cjs, repomix.config.json5, repomix.config.jsonc, repomix.config.json or global config at /Users/giulio/.config/repomix/repomix.config.ts, /Users/giulio/.config/repomix/repomix.config.mts, /Users/giulio/.config/repomix/repomix.config.cts, /Users/giulio/.config/repomix/repomix.config.js, /Users/giulio/.config/repomix/repomix.config.mjs, /Users/giulio/.config/repomix/repomix.config.cjs, /Users/giulio/.config/repomix/repomix.config.json5, /Users/giulio/.config/repomix/repomix.config.jsonc, /Users/giulio/.config/repomix/repomix.config.json.
You can add a config file for additional settings. Please check https://github.com/yamadashy/repomix for more information.
Loaded file config: {}
CLI config: {}
Default config: {
  input: { maxFileSize: 52428800 },
  output: {
    filePath: 'repomix-output.xml',
    style: 'xml',
    parsableStyle: false,
    fileSummary: true,
    directoryStructure: true,
    files: true,
    removeComments: false,
    removeEmptyLines: false,
    compress: false,
    topFilesLength: 5,
    showLineNumbers: false,
    truncateBase64: false,
    copyToClipboard: false,
    includeFullDirectoryStructure: false,
    tokenCountTree: false,
    git: {
      sortByChanges: true,
      sortByChangesMaxCommits: 100,
      includeDiffs: false,
      includeLogs: false,
      includeLogsCount: 50
    }
  },
  include: [],
  ignore: { useGitignore: true, useDefaultPatterns: true, customPatterns: [] },
  security: { enableSecurityCheck: true },
  tokenCount: { encoding: 'o200k_base' }
}
Default output file path is set to: repomix-output.xml
Merged config: {
  input: { maxFileSize: 52428800 },
  output: {
    filePath: 'repomix-output.xml',
    style: 'xml',
    parsableStyle: false,
    fileSummary: true,
    directoryStructure: true,
    files: true,
    removeComments: false,
    removeEmptyLines: false,
    compress: false,
    topFilesLength: 5,
    showLineNumbers: false,
    truncateBase64: false,
    copyToClipboard: false,
    includeFullDirectoryStructure: false,
    tokenCountTree: false,
    git: {
      sortByChanges: true,
      sortByChangesMaxCommits: 100,
      includeDiffs: false,
      includeLogs: false,
      includeLogsCount: 50
    }
  },
  include: [],
  ignore: { useGitignore: true, useDefaultPatterns: true, customPatterns: [] },
  security: { enableSecurityCheck: true },
  tokenCount: { encoding: 'o200k_base' },
  cwd: '/Users/giulio/dev/paperone'
}
Reading file paths from stdin...
Resolved path: .envrc -> /Users/giulio/dev/paperone/.envrc
Resolved path: .gitignore -> /Users/giulio/dev/paperone/.gitignore
Resolved path: __init__.py -> /Users/giulio/dev/paperone/__init__.py
Resolved path: devenv.lock -> /Users/giulio/dev/paperone/devenv.lock
Resolved path: devenv.nix -> /Users/giulio/dev/paperone/devenv.nix
Resolved path: devenv.yaml -> /Users/giulio/dev/paperone/devenv.yaml
Resolved path: paperone/__init__.py -> /Users/giulio/dev/paperone/paperone/__init__.py
Resolved path: paperone/client.py -> /Users/giulio/dev/paperone/paperone/client.py
Resolved path: paperone/database.py -> /Users/giulio/dev/paperone/paperone/database.py
Resolved path: paperone/entities.py -> /Users/giulio/dev/paperone/paperone/entities.py
Resolved path: paperone/models.py -> /Users/giulio/dev/paperone/paperone/models.py
Resolved path: paperone/taapi.py -> /Users/giulio/dev/paperone/paperone/taapi.py
Resolved path: paperone/utils.py -> /Users/giulio/dev/paperone/paperone/utils.py
Resolved path: poetry.lock -> /Users/giulio/dev/paperone/poetry.lock
Resolved path: populate.py -> /Users/giulio/dev/paperone/populate.py
Resolved path: pyproject.toml -> /Users/giulio/dev/paperone/pyproject.toml
Found 16 file paths from stdin
Read 16 file paths from stdin in main process
Initializing worker pool with min=1, max=1 threads, runtime=child_process. Worker path: file:///Users/giulio/.npm/_npx/e34444800c30a7c5/node_modules/repomix/lib/cli/actions/workers/defaultActionWorker.js
Tinypool initialization took 2.92ms
Worker: Using pre-loaded config: {
  input: { maxFileSize: 52428800 },
  output: {
    filePath: 'repomix-output.xml',
    style: 'xml',
    parsableStyle: false,
    fileSummary: true,
    directoryStructure: true,
    files: true,
    removeComments: false,
    removeEmptyLines: false,
    compress: false,
    topFilesLength: 5,
    showLineNumbers: false,
    truncateBase64: false,
    copyToClipboard: false,
    includeFullDirectoryStructure: false,
    tokenCountTree: false,
    git: {
      sortByChanges: true,
      sortByChangesMaxCommits: 100,
      includeDiffs: false,
      includeLogs: false,
      includeLogsCount: 50
    }
  },
  include: [],
  ignore: { useGitignore: true, useDefaultPatterns: true, customPatterns: [] },
  security: { enableSecurityCheck: true },
  tokenCount: { encoding: 'o200k_base' },
  cwd: '/Users/giulio/dev/paperone'
}
Worker: Processing 16 files from stdin
Memory [Pack - Start] | Heap: 12.46/18.88MB (66%) | RSS: 66.47MB | Ext: 2.24MB
Memory [Search Files - Before] | Heap: 12.48/18.88MB (66.1%) | RSS: 66.48MB | Ext: 2.21MB
Adding default ignore patterns
Adding output file to ignore patterns: repomix-output.xml
Adding custom ignore patterns: []
Ignore patterns: [
  '.git/**',
  '.hg/**',
  '.hgignore',
  '.svn/**',
  '**/node_modules/**',
  '**/bower_components/**',
  '**/jspm_packages/**',
  'vendor/**',
  '**/.bundle/**',
  '**/.gradle/**',
  'target/**',
  'logs/**',
  '**/*.log/**',
  '**/npm-debug.log*/**',
  '**/yarn-debug.log*/**',
  '**/yarn-error.log*/**',
  'pids/**',
  '*.pid',
  '*.seed',
  '*.pid.lock',
  'lib-cov/**',
  'coverage/**',
  '.nyc_output/**',
  '.grunt/**',
  '.lock-wscript',
  'build/Release/**',
  'typings/**',
  '**/.npm/**',
  '.eslintcache',
  '.rollup.cache/**',
  '.webpack.cache/**',
  '.parcel-cache/**',
  '.sass-cache/**',
  '*.cache',
  '.node_repl_history',
  '*.tgz',
  '**/.yarn/**',
  '**/.yarn-integrity/**',
  '.env',
  '.next/**',
  '.nuxt/**',
  '.vuepress/dist/**',
  '.serverless/**',
  '.fusebox/**',
  '.dynamodb/**',
  'dist/**',
  '**/.DS_Store/**',
  '**/Thumbs.db/**',
  '.idea/**',
  '.vscode/**',
  '**/*.swp/**',
  '**/*.swo/**',
  '**/*.swn/**',
  '**/*.bak/**',
  'build/**',
  'out/**',
  'tmp/**',
  'temp/**',
  '**/repomix-output.*/**',
  '**/repopack-output.*/**',
  '**/package-lock.json/**',
  '**/yarn-error.log/**',
  '**/yarn.lock/**',
  '**/pnpm-lock.yaml/**',
  '**/bun.lockb/**',
  '**/bun.lock/**',
  '**/__pycache__/**',
  '**/*.py[cod]/**',
  '**/venv/**',
  '**/.venv/**',
  '**/.pytest_cache/**',
  '**/.mypy_cache/**',
  '**/.ipynb_checkpoints/**',
  '**/Pipfile.lock/**',
  '**/poetry.lock/**',
  '**/uv.lock/**',
  '**/Cargo.lock/**',
  '**/Cargo.toml.orig/**',
  '**/target/**',
  '**/*.rs.bk/**',
  '**/composer.lock/**',
  '**/Gemfile.lock/**',
  '**/go.sum/**',
  '**/mix.lock/**',
  '**/stack.yaml.lock/**',
  '**/cabal.project.freeze/**',
  'repomix-output.xml'
]
Ignore file patterns: [ '**/.gitignore', '**/.repomixignore' ]
Include patterns with explicit files: [
  '.envrc',
  '.gitignore',
  '__init__.py',
  'devenv.lock',
  'devenv.nix',
  'devenv.yaml',
  'paperone/__init__.py',
  'paperone/client.py',
  'paperone/database.py',
  'paperone/entities.py',
  'paperone/models.py',
  'paperone/taapi.py',
  'paperone/utils.py',
  'poetry.lock',
  'populate.py',
  'pyproject.toml'
]
^C
Received SIGINT. Shutting down...

This is with git ls-files. Same issue without specifying any argument, only including the right files, or excluding the complementary. I have Repomix working correctly on Linux hosts.

Usage Context

Repomix CLI

Repomix Version

1.5 - 1.6 - 1.7 - 1.8

Node.js Version

v22.9.0

[yamadashy]

Hi, @peperunas !
Thank you for reporting this issue!

While I haven't identified the root cause yet, it appears that Repomix occasionally freezes during file processing. I will continue investigating this issue.

Related issue:

• Repomix hangs while processing certain files #846

[yamadashy]

Based on the verbose logs, the process hangs after displaying "Include patterns with explicit files" during the worker pool file processing phase. This suggests the issue might be related to:

1. Worker pool processing hanging on certain files
2. Environment-specific issues (macOS in your case, Docker in Repomix hangs while processing certain files #846)
3. Lack of proper timeout/error handling in the worker threads

I'll investigate the worker pool implementation and file processing logic to identify the root cause.

[peperunas]

Thank you for keeping me posted and the support, I really appreciate it.

[yamadashy]

I couldn't reproduce this on my macOS, so it might be environment or repository-specific.

I'll create a PR with a potential fix.