I usually start with simpler things like paying attention to locality of reference and adjusting data so that it takes up less space in memory.