Generally if one has carpet mats in one's car, the driver's mat tends to have the heaviest wear, and wears out faster than the other three mats.
One can now purchase OE single driver's carpet mats for some vehicles, which will save having to buy completely new sets in the above scenario.
Available from Parts King, your local Toyota dealer or the Official Toyota Store on Ebay