You can narrow the colour down by the bud shape (not from the random Misc seeds).

Round, Square, Crescent: 
 
*Small left leaning bud ----- red, green or violet
*Small right leaning bud ----orange or blue
*Fat bud  --------------------- yellow or indigo
_______________________________

Loop, Pentagon:

*Small left leaning bud----- yellow or indigo
*Small right leaning bud ---red, green or violet
*Fat bud -------------------- orange or blue
______________________________

Triangle, Heart:

*Small left leaning bud: ---- orange or blue
*Small right leaning bud:---yellow or indigo
*Fat bud ------------------- red, green or violet