Can you post a list with active modules?
How many entries are there in your term_node table?
Do you use revisions?
What did devel report as the slowest querys?
Do you have slow-query-log active on mysql? (What does it say?)

We have some experience with speeding up drupal, but figuring out the bottleneck needs to get done first