I think it all depends on what fish and decor you have in your tank. If you want the fish to blend in, get gravel or sand that is more towards the fishes color. If you want the fish to stand out in your tank, get the opposite colored gravel.
For SW, sand is the only way to go