@foss.global/codefeed
Generate an activity feed from forge providers. The default provider scans a Gitea instance; CodeFeedGitManagerProvider adapts a local @foss.global/gitmanager instance. CodeFeed retrieves commits since a configurable timestamp and enriches them with tags, optional npm publish detection, and CHANGELOG snippets.
Issue Reporting and Security
For reporting bugs, issues, or security vulnerabilities, please visit community.foss.global/. This is the central community hub for all issue reporting. Developers who sign and comply with our contribution agreement and go through identification can also get a code.foss.global/ account to submit Pull Requests directly.
Install
pnpm add @foss.global/codefeed
Requires Node.js 18+ (global fetch/Request/Response) and ESM.
Quick Start
import { CodeFeed } from '@foss.global/codefeed';
// Fetch commits since one week ago (default), no caching
const feed = new CodeFeed('https://code.example.com', 'gitea_token');
const commits = await feed.fetchAllCommitsFromInstance();
console.log(commits);
With options
const thirtyDays = 30 * 24 * 60 * 60 * 1000;
const since = new Date(Date.now() - thirtyDays).toISOString();
const feed = new CodeFeed('https://code.example.com', 'gitea_token', since, {
enableCache: true, // keep results in memory
cacheWindowMs: thirtyDays, // trim cache to this window
enableNpmCheck: true, // check npm for published versions
taggedOnly: false, // return all commits (or only tagged)
orgAllowlist: ['myorg'], // only scan these orgs
orgDenylist: ['archive'], // skip these orgs
repoAllowlist: ['myorg/app1', 'myorg/app2'], // only these repos
repoDenylist: ['myorg/old-repo'], // skip these repos
untilTimestamp: new Date().toISOString(), // optional upper bound
verbose: true, // print a short metrics summary
});
const commits = await feed.fetchAllCommitsFromInstance();
Advanced callers can provide a custom ICodeFeedProvider through the constructor options. The default provider keeps the existing Gitea HTTP behavior, while the provider contract lets adapters supply organizations, repositories, commits, tags, and changelog content from another backend.
With GitManager
import { CodeFeed, CodeFeedGitManagerProvider } from '@foss.global/codefeed';
import { GitManager } from '@foss.global/gitmanager';
const since = new Date(Date.now() - 7 * 24 * 60 * 60 * 1000).toISOString();
const gitManager = new GitManager({
dataDir: '/var/lib/foss-global/gitmanager',
});
await gitManager.start();
const feed = new CodeFeed('gitmanager://local', undefined, since, {
provider: new CodeFeedGitManagerProvider({ gitManager }),
enableNpmCheck: false,
});
const commits = await feed.fetchAllCommitsFromInstance();
await gitManager.stop();
Public GitManager read models
GitManagerPublicReadClient is an in-process adapter from a running GitManager to the shared public response models. It supports exactly five read methods:
getOverview(query?)getOrg(org)getRepo(org, repo, path?, issueNumber?)getFile(org, repo, path)getCommits(org, repo, sha?)
Construction is default-deny. Provide an authoritative isRepositoryPublic predicate, or set allowAllRepositories: true only when every repository managed by the supplied GitManager is public:
import { GitManagerPublicReadClient } from '@foss.global/codefeed';
const publicRepositories = new Set([
'foss.global/interfaces',
'foss.global/gitmanager',
]);
const publicReads = new GitManagerPublicReadClient({
gitManager,
publicBaseUrl: 'https://foss.global',
smartHttpBaseUrl: 'https://foss.global',
isRepositoryPublic: async (repository) =>
publicRepositories.has(`${repository.org}/${repository.repo}`),
});
const overview = await publicReads.getOverview();
const repository = await publicReads.getRepo('foss.global', 'gitmanager');
Construction fails when neither visibility option is supplied. Predicate failures reject the request, so visibility checks fail closed. When allowAllRepositories is true, the predicate is bypassed.
Public-model visibility and GitManager Smart HTTP visibility are separate policy surfaces. Synchronize both from the same authoritative source. A generated cloneUrl or sshUrl describes a URL; it does not prove that the corresponding transport is available or that the caller is authorized.
URL defaults:
publicBaseUrl:https://foss.globalsmartHttpBaseUrl: the configuredpublicBaseUrlsshBaseUrl:ssh://git@code.foss.global:29419
Bounded safe-integer options:
maxCommits:40; accepted range 1–1,000.maxReleases:50; accepted range 1–1,000.maxLanguageFiles:1,000; accepted range 1–10,000.maxConcurrency:8; accepted range 1–32.
Optional organizationMetadata, repositoryMetadata, and newsProvider callbacks enrich the mapped response data. They do not add forge capabilities. Models intentionally leave members, issues, issue comments, release assets, download URLs, forge metrics, identity fields, and verification fields empty when GitManager has no authoritative source for them. The optional issueNumber argument is accepted for public-request compatibility and currently ignored.
Individual GitManager read failures may map to empty or null fallback data so one unavailable tree, file, tag, commit list, or diff does not necessarily fail the whole public model. Visibility predicate failures are not converted to fallbacks.
This client does not start an HTTP server, configure Git Smart HTTP or SSH, terminate TLS, authenticate users, or implement write/admin APIs. A server layer can call these methods from its own authenticated typed handlers.
CodeFeed.fetchAllCommitsFromInstance() returns items with this shape:
interface ICommitResult {
baseUrl: string;
org: string;
repo: string;
timestamp: string; // ISO date
hash: string; // commit SHA
commitMessage: string;
tagged: boolean; // commit is pointed to by a tag
publishedOnNpm: boolean; // only when npm check enabled and tag matches
prettyAgoTime: string; // human-readable diff
changelog: string | undefined; // snippet for matching tag version
}
The canonical public result contract is exported as ICodefeedCommitResult from @foss.global/interfaces. @foss.global/codefeed/interfaces keeps ICommitResult as a package-local alias for that contract.
Features
- Pagination for orgs, repos, commits, and tags (no missing pages)
- Retries with exponential backoff for 429/5xx and network errors
- CHANGELOG discovery with case variants (
CHANGELOG.md,changelog.md,docs/CHANGELOG.md) - Tag-to-version mapping based on tag names (
vX.Y.Z→X.Y.Z) - Optional npm publish detection via
@org/repopackage versions - GitManager provider adapter for repositories managed by
@foss.global/gitmanager - Default-deny GitManager public read-model adapter for overview, organization, repository, file, and commit responses
- In-memory caching with window trimming and stable sorting
- Allow/deny filters for orgs and repos, optional time upper bound
- One-line metrics summary when
verbose: true
Environment
- Gitea base URL and an optional token with read access
- For GitManager-backed feeds, a started
GitManagerinstance with imported or local repositories - For public GitManager reads, an authoritative repository-visibility source or an explicit all-public declaration
- Node.js 18+ (global fetch)
Testing
The repo contains:
- An opt-in integration test using a
GITEA_TOKENfrom.nogit/via@push.rocks/qenv. - A mocked pagination test that does not require network.
- A GitManager provider mapping test using a local test stub.
- A default-deny GitManager public-client mapping test using a local test stub.
Run tests:
pnpm test
For the integration test, set CODEFEED_RUN_LIVE=true and ensure GITEA_TOKEN is provided, e.g. via .nogit/ as used by test/test.live.node.ts.
Notes
- When
taggedOnlyis enabled, the feed includes only commits associated with tags. publishedOnNpmis computed by matching the tag-derived version against the npm registry for@org/repo.- For very large instances, consider using allowlists/denylists and enabling caching for incremental runs.
License and Legal Information
This repository contains open-source code licensed under the MIT License. A copy of the license can be found in the repository license file.
Please note: The MIT License does not grant permission to use the trade names, trademarks, service marks, or product names of the project, except as required for reasonable and customary use in describing the origin of the work and reproducing the content of the NOTICE file.
Trademarks
This project is owned and maintained by Task Venture Capital GmbH. The names and logos associated with Task Venture Capital GmbH and any related products or services are trademarks of Task Venture Capital GmbH or third parties, and are not included within the scope of the MIT license granted herein.
Use of these trademarks must comply with Task Venture Capital GmbH's Trademark Guidelines or the guidelines of the respective third-party owners, and any usage must be approved in writing. Third-party trademarks used herein are the property of their respective owners and used only in a descriptive manner, e.g. for an implementation of an API or similar.
Company Information
Task Venture Capital GmbH
Registered at District Court Bremen HRB 35230 HB, Germany
For any legal inquiries or further information, please contact us via email at hello@task.vc.
By using this repository, you acknowledge that you have read this section, agree to comply with its terms, and understand that the licensing of the code does not imply endorsement by Task Venture Capital GmbH of any derivative works.