To-do: Difference between revisions

From No-Intro ~ Wiki
Jump to navigation Jump to search
No edit summary
mNo edit summary
Line 4: Line 4:
{| class="wikitable" style="width: 100%;"
{| class="wikitable" style="width: 100%;"
|-
|-
! style="width: 10%" | Time Period
! style="width: 10%" | Category
! style="width: 10%" | Category
! style="width: 70%" | Item
! style="width: 60%" | Item
! style="width: 20%" | Status
! style="width: 20%" | Status
|-
|-
|
| Interface
| Interface
| Page should be responsive, not fixed-width.
| Page should be responsive, not fixed-width.
|
|
|-
|-
|
| Interface
| Interface
| Search bar on every page, that can search titles+hashes+serials for every system (like redump)
| Search bar on every page, that can search titles+hashes+serials for every system (like redump)
|
|
|-
|-
|
| Interface
| Interface
| Solicit feedback/help on the DoM sidebar?
| Solicit feedback/help on the DoM sidebar?
|
|
|-
|-
|
| Interface
| Interface
| Keep users logged in for longer
| Keep users logged in for longer
|
|
|-
|-
|
| Interface
| Interface
| Login box at top of page
| Login box at top of page
| Done
| Done
|-
|-
|
| Interface
| Interface
| Remember last page/system/search-settings
| Remember last page/system/search-settings
|
|
|-
|-
|
| Database
| Database
| Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to  
| Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to  
|
|
|-
|-
|
| Database
| Database
| Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing.
| Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing.
|
|
|-
|-
|
| Database
| Database
| Locked DATs should still be viewable.
| Locked DATs should still be viewable.
|
|
|-
|-
|
| Database
| Database
| It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page
| It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page
|
|
|-
|-
|
| Database
| Database
| "Extra" (user-specified) fields like the archive has would be useful for sources and files too
| "Extra" (user-specified) fields like the archive has would be useful for sources and files too
|
|
|-
|-
|
| Database
| Database
| If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing".
| If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing".
|
|
|-
|-
|
| Database
| Database
| DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that.
| DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that.
|
|
|-
|-
|
| Database
| Database
| Dynamic cue generation/download for Non-Redump dats
| Dynamic cue generation/download for Non-Redump dats
|
|
|-
|-
|
| Database
| Database
| Create new homepage design, including easy-to-use undumped list/database lookup tool
| Create new homepage design, including easy-to-use undumped list/database lookup tool
| WIP by Hiccup
| WIP by Hiccup
|-
|-
|
| Database
| Database
| A new, modern, database should be developed.
| A new, modern, database should be developed.
| There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on.
| There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on.
|-
|-
|
| Database
| Database
| Exclude the header skipper tag in the NES dat by default
| Exclude the header skipper tag in the NES dat by default
|  
|  
|-
|-
|
| Database
| Database
| Add form to search by datter
| Add form to search by datter
|  
|  
|-
|-
| Long-term
| Database
| Allow customised daily packs (same options as with individual packs)
|
|-
|
| Data Import/Export
| Data Import/Export
| Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up"
| Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up"
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML
| Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Make import XML support all DoM fields and use names consistent with those DoM fields
| Make import XML support all DoM fields and use names consistent with those DoM fields
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Create schema for import XML
| Create schema for import XML
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Use same XML format for export (instead of the "plain text" format that doesn't have all the fields)
| Use same XML format for export (instead of the "plain text" format that doesn't have all the fields)
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Create API to allow specific data to be retrieved/added to DoM:
| Create API to allow specific data to be retrieved/added to DoM:
Line 107: Line 137:
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins)
| Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins)
|
|
|-
|-
|
| Data Import/Export
| Data Import/Export
| Allow CSV import
| Allow CSV import
|
|
|-
|-
|
| New Database Fields
| New Database Fields
| All fields where people use commas to separate values should probably be split into multiple fields?
| All fields where people use commas to separate values should probably be split into multiple fields?
|
|
|-
|-
|
| New Database Fields
| New Database Fields
| Scene releases should have a Region field, like "normal" sources.
| Scene releases should have a Region field, like "normal" sources.
| Done
| Done
|-
|-
|
| New Database Fields
| New Database Fields
| Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash).
| Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash).
|
|
|-
|-
|
| Input Validation
| Input Validation
| Some formats should have certain file extensions and vice versa. E.g.:
| Some formats should have certain file extensions and vice versa. E.g.:
Line 132: Line 168:
|  
|  
|-
|-
|
| Input Validation
| Input Validation
| Serials generally follow a certain format
| Serials generally follow a certain format
Line 137: Line 174:
|  
|  
|-
|-
|
| Input Validation
| Input Validation
| There is generally a fixed list of PCB serials for each system.
| There is generally a fixed list of PCB serials for each system.
|  
|  
|-
|-
|
| Input Validation
| Input Validation
| Some sizes are invalid (or unlikely) for some systems
| Some sizes are invalid (or unlikely) for some systems
Line 154: Line 193:
|Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively)
|Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively)
|
|
|}
===Batch-adding SHA56 to files===
{| class="wikitable" style="width: 100%;"
|-
! style="width: 80%" | Item
! style="width: 20%" | Status
|-
|Add SHA256 to NES
|Done for included ROMs
|}
|}



Revision as of 06:08, 9 May 2022

Website

Various suggestions from unexpectedpanda

Time Period Category Item Status
Interface Page should be responsive, not fixed-width.
Interface Search bar on every page, that can search titles+hashes+serials for every system (like redump)
Interface Solicit feedback/help on the DoM sidebar?
Interface Keep users logged in for longer
Interface Login box at top of page Done
Interface Remember last page/system/search-settings
Database Put more stuff in parameters in URL (e.g. for search) so that more stuff can be linked to
Database Each archive (at least) could have a permanent ID (GUID or similar), and pages should be accessible via URL with that ID, so that database entries can be referred to by third party projects (like Wikidata), without there being a risk of the ID changing.
Database Locked DATs should still be viewable.
Database It would be more efficient for the user if all forms (archive, source, file, attachment) were all on one edit page
Database "Extra" (user-specified) fields like the archive has would be useful for sources and files too
Database If an archive only has some files MIA, then the tag in Search and the top of the archive page should say "Partially Missing" or something like that, not just say "Missing".
Database DAT files could be cryptographically signed so people can tell if reuploads of the dat files are genuine. Probably best to include a text file with the filename, size in bytes and sha256 of each file in the download, and then sign that.
Database Dynamic cue generation/download for Non-Redump dats
Database Create new homepage design, including easy-to-use undumped list/database lookup tool WIP by Hiccup
Database A new, modern, database should be developed. There is something in development by a third party in private, that is making good progress. May be worth waiting to see how that gets on.
Database Exclude the header skipper tag in the NES dat by default
Database Add form to search by datter
Long-term Database Allow customised daily packs (same options as with individual packs)
Data Import/Export Create a YAML/YAML-like format for submissions in forums, as an alternative for the formats people end up "making up"
Data Import/Export Create a script that datters can use locally to convert the YAML format (or just variable human-readable text format) into the DoM import XML
Data Import/Export Make import XML support all DoM fields and use names consistent with those DoM fields
Data Import/Export Create schema for import XML
Data Import/Export Use same XML format for export (instead of the "plain text" format that doesn't have all the fields)
Data Import/Export Create API to allow specific data to be retrieved/added to DoM:
  • Allows emulators/dump tools to interact with DoM
  • Check ROM status
  • Submit data directly
Data Import/Export Change-request system. I.e. Datters could accept/reject/edit/add comments to submissions by non-datters (maybe even people without logins)
Data Import/Export Allow CSV import
New Database Fields All fields where people use commas to separate values should probably be split into multiple fields?
New Database Fields Scene releases should have a Region field, like "normal" sources. Done
New Database Fields Maybe add faster hash types. E.g. BLAKE3 (cryptographic hash, faster than SHA256 but less common) or xxhash (even faster but not a cryptographic hash).
Input Validation Some formats should have certain file extensions and vice versa. E.g.:
  • N64 - BigEndian = z64, ByteSwapped = v64.
Input Validation Serials generally follow a certain format
  • N64 - BigEndian = z64, ByteSwapped = v64.
Input Validation There is generally a fixed list of PCB serials for each system.
Input Validation Some sizes are invalid (or unlikely) for some systems

DATs

Item Status
Check for ROMs that are in DoM but not in the Nintendo lotcheck sheets/DSi whitelist to find the "blind spots" of the lotcheck sheet/DSi whitelist (e.g. non-Nintendo-manufactured games / games post-2013ish and DS games that uses the newer encryption, respectively)

Batch-adding SHA56 to files

Item Status
Add SHA256 to NES Done for included ROMs

Wii/DSi Digital

Item Status
Add Galaxy's Wii dumps WIP (by xuom2)
Add Galaxy's DSi dumps Done
Add ZedSeven's DSi dumps Done
Add nold's Wii dumps
Wii: Import title version information and title key and title password hashes into database
DSi: Import title version information and title key and title password hashes into database Done
Create software to determine what is undumped and create database entries appropriately
Create software to backup non-title content endpoints (e.g. eshop metadata)
Once all URLs are gathered, send them to Archive Team as they want to make their own backup

3DS/Wii U Digital

Item Status
Add Galaxy's 3DS dumps Done
Add Galaxy's Wii U dumps WIP (by xuom2)
Import the anonymous Wii U dumps WIP (by xuom2)
Determine what is MIA and mark database entries appropriately
Create software to determine what is undumped and create database entries appropriately
Import title version information and title key and title password hashes into database
Create software to backup non-title content endpoints (e.g. eshop metadata)
Merge deprecated dat into current one
Once all URLs are gathered, send them to Archive Team as they want to make their own backup

Switch Digital

Item Status
Make the NSP and CDN formats equal - i.e. extract NCAs from all NSPs and dat them as CDN format, and pack all NCAs into NSPs and dat them as NSP format.
Investigate the fields in CNMTs that contain information on previous title versions.
Develop/find a method to retrieve title contents from the CDN directly, either through emulating the network process on PC or intercepting (and modifying if need be) switch network activity.
Create software to backup non-title content endpoints (e.g. eshop metadata)
Create software to automatically process scene/p2p releases