There's been some cool research being done on the history of the chili pepper:

http://www.eurekalert.org/pub_releases/2007-02/uoc-rhc020907.php

The earliest evidence is in Ecuador around 6100 years ago!