Skip to content

Rewrite BCPD description of the colour data format - #662

Merged
avivace merged 18 commits into
gbdev:masterfrom
quinnyo:bcpd-colour-format
Jun 9, 2026
Merged

Rewrite BCPD description of the colour data format#662
avivace merged 18 commits into
gbdev:masterfrom
quinnyo:bcpd-colour-format

Conversation

@quinnyo

@quinnyo quinnyo commented Apr 19, 2026

Copy link
Copy Markdown
Contributor

This is a rewrite of the BCPD section to hopefully reduce possible confusion and make the colour data format less ambiguous.
Particularly:

  • avoid relying on reader interpretation of 'RGB555'
  • make explicit that "little-endian" is about byte order of the 16 bit colour word
  • reverse the bit table so MSB is first (this table is just about the only one that used the LSB order)
  • explicitly state that you access one byte at a time (need to read/write twice per colour)

Fixes #643 (I think)

@nummacway

Copy link
Copy Markdown
Contributor

I suggest we add an example:
Farbberechnung

@ISSOtm

ISSOtm commented Apr 20, 2026

Copy link
Copy Markdown
Member

That's actually a pretty good idea! A visual representation of how the encoding is transformed is very helpful.

What I would like, actually, is to add a third layer, which shows how the colour is converted into RGB555 format, and then shows the two bytes being swapped in memory. Is the above image available in SVG form? I'd like to tweak it to propose some further improvements. (Perhaps we can add that in a follow-up PR, but still.)

@ISSOtm ISSOtm left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the wording improvements!

Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
@avivace

avivace commented Apr 20, 2026

Copy link
Copy Markdown
Member

rgb555_encoding(1)(1).drawio
I've started trying to redraw it in draw.io @ISSOtm

@nummacway

nummacway commented Apr 20, 2026

Copy link
Copy Markdown
Contributor

Are these two distinct proposals? Or are they two distinct pictures that are both to be added?

For my design, I actually like my "ATA/ATAPI cable" style because it is immediately clear which and how many bits are involved.

@avivace

avivace commented Apr 20, 2026

Copy link
Copy Markdown
Member

I like the cable design as well @nummacway but I couldn't find a way to reproduce it in draw.io (which keeps the diagrams in a 'editable' project XML files so it's a preferred format here) :/

How was your diagram drawn?

@nummacway

Copy link
Copy Markdown
Contributor

Didn't know draw.io was preferred.
I'll change your diagram to snap to grid, to make future updates easier, and will try to have it import my shapes. I found no way to draw this with draw.io's tools.
I drew them in Affinity, because that's what I use. Because the way it exports text, it was never meant as the final result, and I would have recreated it with a text editor.

@nummacway

Copy link
Copy Markdown
Contributor

This is only the top part of the original file.
Farbberechnung.drawio
I found no way of inserting an editable SVG, so I had to recreate my four custom shapes with drawio's language. For reference, these are their source codes (concatenated in a single file):
ataatapi-shapes.xml
I do find my two separate colors for the green "cables" nice, but I have no idea which colors to use to align with Pan Docs. I leave that to you.

For those who don't want to open drawio, here's a screenshot:
image

@ISSOtm

ISSOtm commented Apr 20, 2026

Copy link
Copy Markdown
Member

I've started transcribing the design as a themable SVG (since no matter how much I try, I can't edit SVGs in graphical editors ^^') I'll host a rendered version online when I've gotten parity, though I also have design changes to suggest. In particular, this uses Pan Docs' font, which has different glyph widths, thus we may consider tweaking the font size? (Though I'm also thinking of swapping the values of the red and green components, simply to balance the amount of characters? xD)

image

(Disregard the misaligned digits, I haven't bothered fixing those yet.) One change I've made is that the “ATA ribbons” are drawn behind the borders, which I'm not fully sure about. One possible change is to squish the ribbons vertically by 1 pixel at each edge, so that the black edges still render there. Feel free to throw feedback!

@ISSOtm

ISSOtm commented Apr 20, 2026

Copy link
Copy Markdown
Member

I do find my two separate colors for the green "cables" nice, but I have no idea which colors to use to align with Pan Docs. I leave that to you.

One layout idea I had was to separate the format conversion and the RAM encoding into two separate layers, so there'd be three total: the RGB8 colour, the RGB555 version (still with the “ribbon cables”, and then two arrows pointing out how the bytes are swapped in memory order, and also dotted lines going left and right to suggest that there are more memory cells around.

@quinnyo

quinnyo commented Apr 21, 2026

Copy link
Copy Markdown
Contributor Author

I like the diagram, but it took me a little while to understand where you're coming from.
I see now that it's about the relationship or converting between 24-bit RGB and the CGB. I did not think about 24-bit colour or really any other format or conversion at all while I was working on this. [This probably says more about me than anything else.]

So I don't think I'm really the target audience for the diagram but I can see the value in it because a lot of people would be coming into this more familiar with this flavour of 24-bit colour than any other. It's a good way to illustrate "what RGB555 means" on a technical level.


I've got one issue with the diagram itself: the order of the ribbon layers. Could the blue ribbon be on a higher layer than the green one? (blue should occlude green) RGB --> R, G_low, G_high, B


@ISSOtm @avivace thanks for the review and patches!
[every time I write 'N(-)bit(s)' I have to check what I'm supposed to do, and this time I didn't! 🐧]

@nummacway

Copy link
Copy Markdown
Contributor

The layer idea was: Small cables over wide cables.

@ISSOtm

ISSOtm commented Apr 21, 2026

Copy link
Copy Markdown
Member

My current iteration of the diagrams can be viewed online at https://eldred.fr/pandocs+662/Palettes.html#lcd-color-palettes-cgb-only; criticism welcome.

[EDIT]: Updated with the state of the PR as of #662 (comment).

@nummacway

This comment was marked as resolved.

@ISSOtm

ISSOtm commented May 6, 2026

Copy link
Copy Markdown
Member

Since there have been no replies to my last comment in the last two weeks, I'm going to push my changes to this PR, and we'll keep working from there. Anyone opposed to this, please voice your opinion (now or after) and those changes will be reverted.

@ISSOtm
ISSOtm force-pushed the bcpd-colour-format branch 2 times, most recently from 1b7a344 to f924874 Compare May 6, 2026 19:17
@ISSOtm

ISSOtm commented May 6, 2026

Copy link
Copy Markdown
Member

I'm now personally happy with the state of this PR, but I'd like opinions from @quinnyo and @nummacway before merging.

@ISSOtm
ISSOtm requested a review from avivace May 6, 2026 19:23
@ISSOtm

ISSOtm commented May 6, 2026

Copy link
Copy Markdown
Member

Also @DelayRGC, since she opened the original issue.

@avivace avivace left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor comments

Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
All background colors are initialized as white by the boot ROM, however it is a
good idea to initialize all colors yourself, e.g. if implementing
a soft-reset mechanic.
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. if implementing a soft-reset mechanic.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. if implementing a soft-reset mechanic.
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. by implementing a soft-reset mechanic.

e.g. if implementing ... doesn't sound good

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"by" changes the meaning of the sentence. Maybe "for" would work better?

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That would also change the meaning of the sentence. The point is that it's a good idea to set all palettes yourself if there's any chance that the init code may run more than once, such as if the game has a soft-reset mechanism.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do you think of "for a soft-reset mechanic" rather than "for/by/if implementing a soft-reset mechanic"?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like Isso's original proposal.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Simpler games that only use e.g. a single colour palette generally don't bother initialising more than that, and I don't want to imply that doing so is wrong.

I have moved the tip to the introduction.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, that makes sense, for sure. I kept saying "all the colours" in my previous comment, I suppose just because the text does the same. It doesn't need to say "all".

I'm not sure what the intent/point of the tip is -- outside of the description of the system startup behaviour. Possibly:

  • The system only initialises the palettes when it first starts up.
  • The colours will all be white by default, so the software must set up at least one palette for any background tile(maps) to be visible.
  • At least during the development process, you might want to initialise palettes that you're not using to something discernable, if only to assist in spotting errors/bugs.
  • If you're relying on the palettes being all-white, don't forget to reset that as part of a soft-reset.

Just the fact:

Suggested change
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. if implementing a soft-reset mechanic.
All background colors are initialized as white by the boot ROM.

The software's responsibility:

Suggested change
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. if implementing a soft-reset mechanic.
All background colors are initialized as white by the boot ROM, so the software must set up any palettes it uses in order to have background tilemaps appear as anything other than solid white.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"as anything other than solid white." misses the point.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK. Please explain it to me.

I'm not sure what the intent/point of the tip is -- outside of the description of the system startup behaviour.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

My intent was indeed point 4, but I suppose it doesn't belong in Pan Docs much. Stating the hardware fact only should be sufficient here; we may even move it outside of a tip, though I'll check out the render to make that judgement.

Comment thread src/Palettes.md Outdated
@quinnyo

quinnyo commented May 8, 2026

Copy link
Copy Markdown
Contributor Author

Hi, sorry I haven't been around, I'll be able to have a look at this in a day or so!

@ISSOtm

ISSOtm commented May 29, 2026

Copy link
Copy Markdown
Member

Ping?

@quinnyo

quinnyo commented May 30, 2026

Copy link
Copy Markdown
Contributor Author

Reviewing now, sorry!

@quinnyo quinnyo left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's pretty much there.

The structural change -- moving the explanation out from under the register headings -- is a very welcome one. Good move.

Also good to settle on one set of register names (and on the more sensible Index and Data ones).

The biggest issue I see is not really introduced by this change, but is made more apparent by it -- the lack of basic introductory information about the CGB colours/palettes.

[possible further work] The bit 15 discussion seems to suggest there might be value in adding something about reading/writing hexadecimal colour words. Specifically about the nybbles not being aligned with the R,G,B components and the difficulty in interpreting that.

Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md
Comment thread src/Palettes.md
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
Comment thread src/Palettes.md Outdated
All background colors are initialized as white by the boot ROM, however it is a
good idea to initialize all colors yourself, e.g. if implementing
a soft-reset mechanic.
All background colors are initialized as white by the boot ROM, however it is a good idea to initialize all colors yourself, e.g. if implementing a soft-reset mechanic.

@quinnyo quinnyo May 30, 2026

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, changing it to "by" would make it have a different, also undesirable/confusing meaning. But the "if implementing" thing is odd, and the whole point being made is a bit strange, actually:

When wouldn't it be a good idea to initialise all the colours yourself? If they are all white you can't see anything.
Regardless of the behaviour of the boot ROM, it's a "good idea" to initialise thesome palettes, because you want your palette/s to be the ones being used. At least I think so.

[Note: I don't actually know how true the boot ROM statement is, I assume someone checked.]

I know this behaviour is specific to the BG colours, but this "tip" (and the similar one for OB) could be moved up to the general explanation above -- it's really not specific to the register/s.

Comment thread src/Palettes.md Outdated
@ISSOtm

ISSOtm commented May 31, 2026

Copy link
Copy Markdown
Member

FWIW, my focus is currently on doing some drawing in order to take a break from programming, so I'll review quinn's contributions to the PR after some days. I'll keep it under two weeks though.

Comment thread src/Palettes.md Outdated
@ISSOtm
ISSOtm force-pushed the bcpd-colour-format branch 2 times, most recently from 5222203 to 7849661 Compare June 7, 2026 10:02
@ISSOtm

ISSOtm commented Jun 7, 2026

Copy link
Copy Markdown
Member

Whoops, never mind the pushes, I fat-finger'd a push to the wrong remote ^^'

quinnyo and others added 15 commits June 7, 2026 12:31
- less ambiguous description of the colour data format
- clarify meaning of endianness (byte order)
- reverse the order of the bit table, so MSB appears first, matching
  others
Co-authored-by: Eldred Habert <me@eldred.fr>
Co-authored-by: Eldred Habert <me@eldred.fr>
Co-authored-by: "Janni K." <24881711+nummacway@users.noreply.github.com>
Co-authored-by: Rangi42 <sylvie.oukaour+rangi42@gmail.com>
Those have been deprecated in newer `hardware.inc`, and really,
the header names were hard to read with the duplicated names,
especially the OBJ ones.
Anyone being confused by old code should be able to deduce the
alternate naming from their definitions in the accompanying
`hardware.inc`, or they can look it up on older versions of Pan Docs,
or they can ask and be explained.

I nonetheless expect that the impact will be very low at this point.
Co-authored-by: Quinn <3379314+quinnyo@users.noreply.github.com>
Co-authored-by: Quinn <3379314+quinnyo@users.noreply.github.com>
Fix wildy incorrect arithmetic

Co-authored-by: Eldred Habert <me@eldred.fr>
@ISSOtm
ISSOtm force-pushed the bcpd-colour-format branch from 7849661 to b3a4387 Compare June 7, 2026 10:31
ISSOtm and others added 3 commits June 7, 2026 12:36
Co-authored-by: Quinn <3379314+quinnyo@users.noreply.github.com>
Co-authored-by: Quinn <3379314+quinnyo@users.noreply.github.com>
@ISSOtm

ISSOtm commented Jun 8, 2026

Copy link
Copy Markdown
Member

OK, this should be all of it. Anything else?

@quinnyo quinnyo left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@avivace
avivace merged commit fe24606 into gbdev:master Jun 9, 2026
3 checks passed
@ISSOtm

ISSOtm commented Jun 9, 2026

Copy link
Copy Markdown
Member

Big thanks to everyone who's pushed through this! I think the result is an excellent improvement ^^

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Rewrite Palettes/BCPD/BGPD to be more intuitive

5 participants