Retaining walls require building permits. However, freestanding walls and/or fences six (6) feet or less in height which are located within the required side and rear yard setback area, four (4) feet or less in the required front yard setback area, do not require a building permit.