We amortize the discount or premium to interpret the REAL cost of debt. This cost may vary significantly from the coupon rate.
As you may know, as the market yields rise, the price of the bond decreases. Why? Because no one will buy a bond with a lower coupon than the market. And since the coupon cannot be changed, the price of the bond is decreased by the difference in yields.
Now that we sold the bond at a discount, we will still have to return the face value.
So, we will still pay the coupon AND have to pay the difference between the face value and the price (after deducting the discount).
Since the discount represents the cost of debt just like the coupon, it too is paid in the form of a coupon. But, we have to pay this additional coupon at maturity. In order to avoid a scenario where our debt SUDDENLY increases, we amortize it over the life of the bond considering it a part of the coupon.
The same analogy can be applied to premiums.