To-do: Difference between revisions
Jump to navigation
Jump to search
No edit summary |
mNo edit summary |
||
Line 4: | Line 4: | ||
{| class="wikitable" style="width: 100%;" | {| class="wikitable" style="width: 100%;" | ||
|- | |- | ||
! style="width: 10%" | Time Period | |||
! style="width: 10%" | Category | ! style="width: 10%" | Category | ||
! style="width: | ! style="width: 60%" | Item | ||
! style="width: 20%" | Status | ! style="width: 20%" | Status | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Page should be responsive, not fixed-width. | | Page should be responsive, not fixed-width. | ||
| | | | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Search bar on every page, that can search titles+hashes+serials for every system (like redump) | | Search bar on every page, that can search titles+hashes+serials for every system (like redump) | ||
| | | | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Solicit feedback/help on the DoM sidebar? | | Solicit feedback/help on the DoM sidebar? | ||
| | | | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Keep users logged in for longer | | Keep users logged in for longer | ||
| | | | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Login box at top of page | | Login box at top of page | ||
| Done | | Done | ||
|- | |- | ||
| | |||
| Interface | | Interface | ||
| Remember last page/system/search-settings | | Remember last page/system/search-settings | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to | | Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing. | | Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing. | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Locked DATs should still be viewable. | | Locked DATs should still be viewable. | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page | | It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| "Extra" (user-specified) fields like the archive has would be useful for sources and files too | | "Extra" (user-specified) fields like the archive has would be useful for sources and files too | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing". | | If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing". | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that. | | DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that. | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Dynamic cue generation/download for Non-Redump dats | | Dynamic cue generation/download for Non-Redump dats | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Create new homepage design, including easy-to-use undumped list/database lookup tool | | Create new homepage design, including easy-to-use undumped list/database lookup tool | ||
| WIP by Hiccup | | WIP by Hiccup | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| A new, modern, database should be developed. | | A new, modern, database should be developed. | ||
| There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on. | | There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on. | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Exclude the header skipper tag in the NES dat by default | | Exclude the header skipper tag in the NES dat by default | ||
| | | | ||
|- | |- | ||
| | |||
| Database | | Database | ||
| Add form to search by datter | | Add form to search by datter | ||
| | | | ||
|- | |- | ||
| Long-term | |||
| Database | |||
| Allow customised daily packs (same options as with individual packs) | |||
| | |||
|- | |||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up" | | Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up" | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML | | Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Make import XML support all DoM fields and use names consistent with those DoM fields | | Make import XML support all DoM fields and use names consistent with those DoM fields | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Create schema for import XML | | Create schema for import XML | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Use same XML format for export (instead of the "plain text" format that doesn't have all the fields) | | Use same XML format for export (instead of the "plain text" format that doesn't have all the fields) | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Create API to allow specific data to be retrieved/added to DoM: | | Create API to allow specific data to be retrieved/added to DoM: | ||
Line 107: | Line 137: | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins) | | Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins) | ||
| | | | ||
|- | |- | ||
| | |||
| Data Import/Export | | Data Import/Export | ||
| Allow CSV import | | Allow CSV import | ||
| | | | ||
|- | |- | ||
| | |||
| New Database Fields | | New Database Fields | ||
| All fields where people use commas to separate values should probably be split into multiple fields? | | All fields where people use commas to separate values should probably be split into multiple fields? | ||
| | | | ||
|- | |- | ||
| | |||
| New Database Fields | | New Database Fields | ||
| Scene releases should have a Region field, like "normal" sources. | | Scene releases should have a Region field, like "normal" sources. | ||
| Done | | Done | ||
|- | |- | ||
| | |||
| New Database Fields | | New Database Fields | ||
| Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash). | | Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash). | ||
| | | | ||
|- | |- | ||
| | |||
| Input Validation | | Input Validation | ||
| Some formats should have certain file extensions and vice versa. E.g.: | | Some formats should have certain file extensions and vice versa. E.g.: | ||
Line 132: | Line 168: | ||
| | | | ||
|- | |- | ||
| | |||
| Input Validation | | Input Validation | ||
| Serials generally follow a certain format | | Serials generally follow a certain format | ||
Line 137: | Line 174: | ||
| | | | ||
|- | |- | ||
| | |||
| Input Validation | | Input Validation | ||
| There is generally a fixed list of PCB serials for each system. | | There is generally a fixed list of PCB serials for each system. | ||
| | | | ||
|- | |- | ||
| | |||
| Input Validation | | Input Validation | ||
| Some sizes are invalid (or unlikely) for some systems | | Some sizes are invalid (or unlikely) for some systems | ||
Line 154: | Line 193: | ||
|Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively) | |Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively) | ||
| | | | ||
|} | |||
===Batch-adding SHA56 to files=== | |||
{| class="wikitable" style="width: 100%;" | |||
|- | |||
! style="width: 80%" | Item | |||
! style="width: 20%" | Status | |||
|- | |||
|Add SHA256 to NES | |||
|Done for included ROMs | |||
|} | |} | ||
Revision as of 06:08, 9 May 2022
Website
Various suggestions from unexpectedpanda
Time Period | Category | Item | Status |
---|---|---|---|
Interface | Page should be responsive, not fixed-width. | ||
Interface | Search bar on every page, that can search titles+hashes+serials for every system (like redump) | ||
Interface | Solicit feedback/help on the DoM sidebar? | ||
Interface | Keep users logged in for longer | ||
Interface | Login box at top of page | Done | |
Interface | Remember last page/system/search-settings | ||
Database | Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to | ||
Database | Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing. | ||
Database | Locked DATs should still be viewable. | ||
Database | It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page | ||
Database | "Extra" (user-specified) fields like the archive has would be useful for sources and files too | ||
Database | If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing". | ||
Database | DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that. | ||
Database | Dynamic cue generation/download for Non-Redump dats | ||
Database | Create new homepage design, including easy-to-use undumped list/database lookup tool | WIP by Hiccup | |
Database | A new, modern, database should be developed. | There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on. | |
Database | Exclude the header skipper tag in the NES dat by default | ||
Database | Add form to search by datter | ||
Long-term | Database | Allow customised daily packs (same options as with individual packs) | |
Data Import/Export | Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up" | ||
Data Import/Export | Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML | ||
Data Import/Export | Make import XML support all DoM fields and use names consistent with those DoM fields | ||
Data Import/Export | Create schema for import XML | ||
Data Import/Export | Use same XML format for export (instead of the "plain text" format that doesn't have all the fields) | ||
Data Import/Export | Create API to allow specific data to be retrieved/added to DoM:
|
||
Data Import/Export | Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins) | ||
Data Import/Export | Allow CSV import | ||
New Database Fields | All fields where people use commas to separate values should probably be split into multiple fields? | ||
New Database Fields | Scene releases should have a Region field, like "normal" sources. | Done | |
New Database Fields | Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash). | ||
Input Validation | Some formats should have certain file extensions and vice versa. E.g.:
|
||
Input Validation | Serials generally follow a certain format
|
||
Input Validation | There is generally a fixed list of PCB serials for each system. | ||
Input Validation | Some sizes are invalid (or unlikely) for some systems |
DATs
Item | Status |
---|---|
Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively) |
Batch-adding SHA56 to files
Item | Status |
---|---|
Add SHA256 to NES | Done for included ROMs |
Wii/DSi Digital
Item | Status |
---|---|
Add Galaxy's Wii dumps | WIP (by xuom2) |
Add Galaxy's DSi dumps | Done |
Add ZedSeven's DSi dumps | Done |
Add nold's Wii dumps | |
Wii: Import title version information and title key and title password hashes into database | |
DSi: Import title version information and title key and title password hashes into database | Done |
Create software to determine what is undumped and create database entries appropriately | |
Create software to backup non-title content endpoints (e.g. eshop metadata) | |
Once all URLs are gathered, send them to Archive Team as they want to make their own backup |
3DS/Wii U Digital
Item | Status |
---|---|
Add Galaxy's 3DS dumps | Done |
Add Galaxy's Wii U dumps | WIP (by xuom2) |
Import the anonymous Wii U dumps | WIP (by xuom2) |
Determine what is MIA and mark database entries appropriately | |
Create software to determine what is undumped and create database entries appropriately | |
Import title version information and title key and title password hashes into database | |
Create software to backup non-title content endpoints (e.g. eshop metadata) | |
Merge deprecated dat into current one | |
Once all URLs are gathered, send them to Archive Team as they want to make their own backup |
Switch Digital
Item | Status |
---|---|
Make the NSP and CDN formats equal - i.e. extract NCAs from all NSPs and dat them as CDN format, and pack all NCAs into NSPs and dat them as NSP format. | |
Investigate the fields in CNMTs that contain information on previous title versions. | |
Develop/find a method to retrieve title contents from the CDN directly, either through emulating the network process on PC or intercepting (and modifying if need be) switch network activity. | |
Create software to backup non-title content endpoints (e.g. eshop metadata) | |
Create software to automatically process scene/p2p releases |