You should note that you don't actually lose the contents of the basket. This is because the game only discounts the quantity from the field when the basket is actually delivered to the food stock. This is also applicable to berries, and areas that require "clearing".