Skip to content

Indexing for nixpkgs#893

Open
chinyeungli wants to merge 19 commits into
mainfrom
757_indexing_for_nixpkgs
Open

Indexing for nixpkgs#893
chinyeungli wants to merge 19 commits into
mainfrom
757_indexing_for_nixpkgs

Conversation

@chinyeungli

Copy link
Copy Markdown
Contributor

Ref: #757

Following are some of the printed "base", "purls" and "purls_and_package_data" from the "_mine_and_publish_packageurls" function.

2026-07-02 06:40:57.384273 UTC getting packageURLs for package: CuboCore.coregarage
BASE: pkg:nix/CuboCore.coregarage
PURLS: ['pkg:nix/nixpkgs/CuboCore.coregarage@5.0.1', 'pkg:nix/nixpkgs/CuboCore.coregarage@5.0.0', 'pkg:nix/nixpkgs/CuboCore.coregarage@4.5.0', 'pkg:nix/nixpkgs/CuboCore.coregarage@4.4.0', 'pkg:nix/nixpkgs/CuboCore.coregarage@4.3.0', 'pkg:nix/nixpkgs/CuboCore.coregarage@4.2.0']
PURLS AND PACKAGE DATA: [('pkg:nix/nixpkgs/CuboCore.coregarage@5.0.1', {'name': 'CuboCore.coregarage', 'version': '5.0.1', 'summary': 'Settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3d46470bb3030020f7e1361f33514854f5bfa86d'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2026-06-27T07:37:20Z', 'outputs': [{'name': 'out', 'path': '/nix/store/yagm01j45fxdn15jxkvm0wpv27c824sa-coregarage-5.0.1', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3d46470bb3030020f7e1361f33514854f5bfa86d'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2026-06-27T07:37:20Z', 'outputs': [{'name': 'out', 'path': '/nix/store/6f88v2qx33wh1d2ipakwm6rnj2lm52cl-coregarage-5.0.1', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.coregarage@5.0.0', {'name': 'CuboCore.coregarage', 'version': '5.0.0', 'summary': 'Settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '68a8af93ff4297686cb68880845e61e5e2e41d92'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2026-05-07T03:23:16Z', 'outputs': [{'name': 'out', 'path': '/nix/store/wrvbx9wv529v9ys7w2cqllqxdy342ns8-coregarage-5.0.0', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '68a8af93ff4297686cb68880845e61e5e2e41d92'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2026-05-07T03:23:16Z', 'outputs': [{'name': 'out', 'path': '/nix/store/9jfvkinrniwsv6brnlrb2d2vv5s8ib4r-coregarage-5.0.0', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.coregarage@4.5.0', {'name': 'CuboCore.coregarage', 'version': '4.5.0', 'summary': 'Settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'ebe4301cbd8f81c4f8d3244b3632338bbeb6d49c'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2025-04-17T05:47:26Z', 'outputs': [{'name': 'out', 'path': '/nix/store/zx1igijxps73v9n6zm9ibz5kfcvsxxk4-coregarage-4.5.0', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'ebe4301cbd8f81c4f8d3244b3632338bbeb6d49c'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2025-04-17T05:47:26Z', 'outputs': [{'name': 'out', 'path': '/nix/store/wq07kfl6gm34k2681rrzf0a0vzggcl0m-coregarage-4.5.0', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.coregarage@4.4.0', {'name': 'CuboCore.coregarage', 'version': '4.4.0', 'summary': 'A settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'b2e813ada825ef491546ea81f42ef2d37ce71bf6'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2023-09-16T18:11:59Z', 'outputs': [{'name': 'out', 'path': '/nix/store/wcixv5smkw3aqgkw92qln0cjkz9m97zi-coregarage-4.4.0', 'default': True, 'nar': 'nar/05vnb0ly2xqdsifm603z8fkayn1dx1vq81dcyl18nibwrrx2vm2g.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'b2e813ada825ef491546ea81f42ef2d37ce71bf6'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2023-09-16T18:11:59Z', 'outputs': [{'name': 'out', 'path': '/nix/store/dax688mx6ykkhp96vdsvszx08gw0r35v-coregarage-4.4.0', 'default': True, 'nar': 'nar/07y3r146q5jzp717dwcc8qydq9hnkp7bbjynv0r462193hrlmd40.nar.xz'}]}}}), ('pkg:nix/nixpkgs/CuboCore.coregarage@4.3.0', {'name': 'CuboCore.coregarage', 'version': '4.3.0', 'summary': 'A settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '194c2aa446b2b059886bb68be15ef6736d5a8c31'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2023-03-16T17:26:55Z', 'outputs': [{'name': 'out', 'path': '/nix/store/qikn12kkqg408hwwy5m7ilap8nbizihc-coregarage-4.3.0', 'default': True, 'nar': 'nar/0lyjfkv365891f559c3bn0wmqd8kczvbrf12wqq5flml26frlr20.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '194c2aa446b2b059886bb68be15ef6736d5a8c31'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2023-03-16T17:26:55Z', 'outputs': [{'name': 'out', 'path': '/nix/store/s7rl9aahm3v2a8da2m2a1c228vz1skvw-coregarage-4.3.0', 'default': True, 'nar': 'nar/1z8vcgczvdsgh6zn1p10q0w1h3ws83dwhj80127xacd5xdrv09i8.nar.xz'}]}}}), ('pkg:nix/nixpkgs/CuboCore.coregarage@4.2.0', {'name': 'CuboCore.coregarage', 'version': '4.2.0', 'summary': 'A settings manager for the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '98bb5b77c8c6666824a4c13d23befa1e07210ef1'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2022-02-09T15:24:27Z', 'outputs': [{'name': 'out', 'path': '/nix/store/ahnkqian3p4zgxw02zd1rhdgxfljb9yr-coregarage-4.2.0', 'default': True, 'nar': 'nar/0ij0cajbda9i1k3m6qb1a70i026p281rvak7xpq4mzlskxgdl16r.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3a641defd170a4ef25ce8c7c64cb13f91f867fca'}, 'attr_path': 'CuboCore.coregarage'}, 'last_updated': '2022-02-15T04:21:50Z'}}})]
2026-07-02 06:40:59.918441 UTC getting packageURLs for package: CuboCore.corehunt
BASE: pkg:nix/CuboCore.corehunt
PURLS: ['pkg:nix/nixpkgs/CuboCore.corehunt@5.0.1', 'pkg:nix/nixpkgs/CuboCore.corehunt@5.0.0', 'pkg:nix/nixpkgs/CuboCore.corehunt@4.5.0', 'pkg:nix/nixpkgs/CuboCore.corehunt@4.4.0', 'pkg:nix/nixpkgs/CuboCore.corehunt@4.3.0', 'pkg:nix/nixpkgs/CuboCore.corehunt@4.2.0']
PURLS AND PACKAGE DATA: [('pkg:nix/nixpkgs/CuboCore.corehunt@5.0.1', {'name': 'CuboCore.corehunt', 'version': '5.0.1', 'summary': 'File finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3d46470bb3030020f7e1361f33514854f5bfa86d'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2026-06-27T07:37:20Z', 'outputs': [{'name': 'out', 'path': '/nix/store/qr48rxw8afwzdr8mmfpaic5dgdsc92ni-corehunt-5.0.1', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3d46470bb3030020f7e1361f33514854f5bfa86d'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2026-06-27T07:37:20Z', 'outputs': [{'name': 'out', 'path': '/nix/store/h7fsxqq3vcjjvwg99039272il4hyhx8v-corehunt-5.0.1', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.corehunt@5.0.0', {'name': 'CuboCore.corehunt', 'version': '5.0.0', 'summary': 'File finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '68a8af93ff4297686cb68880845e61e5e2e41d92'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2026-05-07T03:23:16Z', 'outputs': [{'name': 'out', 'path': '/nix/store/jrn7szblwm9w0j7jnmbwphxmysli1qri-corehunt-5.0.0', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '68a8af93ff4297686cb68880845e61e5e2e41d92'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2026-05-07T03:23:16Z', 'outputs': [{'name': 'out', 'path': '/nix/store/pvhgjz95n0nzi3pzkryhqp4gdikdhif6-corehunt-5.0.0', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.corehunt@4.5.0', {'name': 'CuboCore.corehunt', 'version': '4.5.0', 'summary': 'File finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'ebe4301cbd8f81c4f8d3244b3632338bbeb6d49c'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2025-04-17T05:47:26Z', 'outputs': [{'name': 'out', 'path': '/nix/store/z2v9hq3nxb56bnk4sf2v71j9c8ax7sfc-corehunt-4.5.0', 'default': True}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'ebe4301cbd8f81c4f8d3244b3632338bbeb6d49c'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2025-04-17T05:47:26Z', 'outputs': [{'name': 'out', 'path': '/nix/store/0h8xyq87ai3haxydd4f8qgd67d8jha5r-corehunt-4.5.0', 'default': True}]}}}), ('pkg:nix/nixpkgs/CuboCore.corehunt@4.4.0', {'name': 'CuboCore.corehunt', 'version': '4.4.0', 'summary': 'A file finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'b2e813ada825ef491546ea81f42ef2d37ce71bf6'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2023-09-16T18:11:59Z', 'outputs': [{'name': 'out', 'path': '/nix/store/ys2wywrqgg04pfc7kwchlx1xnvwqicqc-corehunt-4.4.0', 'default': True, 'nar': 'nar/0zmhrz8xh29591lk2fryzamd0fdy8cqmr6s1187gjd3w4msy2shq.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': 'b2e813ada825ef491546ea81f42ef2d37ce71bf6'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2023-09-16T18:11:59Z', 'outputs': [{'name': 'out', 'path': '/nix/store/pkifbscdn0frbmmiaz33z8a0n7vm7kw0-corehunt-4.4.0', 'default': True, 'nar': 'nar/10w6dqxzslxrjhicjrvx4k932vb57nb13ppi8179qim3q21xhs26.nar.xz'}]}}}), ('pkg:nix/nixpkgs/CuboCore.corehunt@4.3.0', {'name': 'CuboCore.corehunt', 'version': '4.3.0', 'summary': 'A file finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '194c2aa446b2b059886bb68be15ef6736d5a8c31'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2023-03-16T17:26:55Z', 'outputs': [{'name': 'out', 'path': '/nix/store/hgb3768q26hn0x5gs06gg9rhxas3mwbw-corehunt-4.3.0', 'default': True, 'nar': 'nar/1m1ld46hiii0y9w21hzxamqzg1533qx6wh49b25l2r53isigyciq.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '194c2aa446b2b059886bb68be15ef6736d5a8c31'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2023-03-16T17:26:55Z', 'outputs': [{'name': 'out', 'path': '/nix/store/5rkg954xb49q4z2mnfmg0i523l8yrzlj-corehunt-4.3.0', 'default': True, 'nar': 'nar/0n5j04l3chxzij8fdng6ja4h9nhr85wfhzvw6z2ncpclj2xyvdld.nar.xz'}]}}}), ('pkg:nix/nixpkgs/CuboCore.corehunt@4.2.0', {'name': 'CuboCore.corehunt', 'version': '4.2.0', 'summary': 'A file finder utility from the C Suite', 'systems': {'aarch64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '98bb5b77c8c6666824a4c13d23befa1e07210ef1'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2022-02-09T15:24:27Z', 'outputs': [{'name': 'out', 'path': '/nix/store/hil3n2y26m8y5vl8hkdvcgpc2jkq6q9s-corehunt-4.2.0', 'default': True, 'nar': 'nar/0r5yp87j86xs16bhzgy1xxvnvwy6rgmigkyb1gg4fnqnxm6qs8z5.nar.xz'}]}, 'x86_64-linux': {'flake_installable': {'ref': {'type': 'github', 'owner': 'NixOS', 'repo': 'nixpkgs', 'rev': '3a641defd170a4ef25ce8c7c64cb13f91f867fca'}, 'attr_path': 'CuboCore.corehunt'}, 'last_updated': '2022-02-15T04:21:50Z'}}})]

The base is the versionless PURL of the package.
The purls list contains all PURLs (different versions) that can be collected/constructed for that specific base package.
The purls_and_package_data is a list contains [(purl, metadata collected)]

chinyeungli and others added 18 commits June 5, 2026 14:48
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
…tead of using `nix` command

 * This approach doesn't require the host to install 'nix' to get the package list
 * This approach doesn't need to clone the nixpkgs repo

Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
    * Specify browser user agent to avoid being 403'd

Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Jono Yang <jyang@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
…e as similar as the debian.py #637

Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Signed-off-by: Chin Yeung Li <tli@nexb.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants