That's basically all my act is - it's just listening all the time and watching for what people do with their hands and so on. It gets on people's nerves a bit - especially when you're at a wedding and you're scribbling on a table and they go 'stop doing that' and you go 'I can't.'
I always craft my words to the point where I think and hope they're perfect before I ever begin sketching.
