GPU parallelism

I need to do simple operation (only copying to graphics memory and writing texture to the application frame buffer) with graphics pipeline on GPU and make mathematics on GPU. Can this two stream of operation be parallel on GPU?

I hope it wont be wrong if I ask to advice a good reliable source about modern GPU architecture for programmers.

Thanks.