A compact fiber optic accelerometer based on a Michelson interferometer is proposed and demonstrated. In the proposed system, the sensing element consists of two single-mode fibers glued together by epoxy, which then act as a simple supported beam. By demodulating the optical phase shift, the acceleration is determined as proportional to the force applied on the central position of the two single-mode fibers. This simple model is able to calculate the sensitivity and the resonant frequency of the compact accelerometer. The experimental results show that the sensitivity and the resonant frequency of the accelerometer are 0.42 rad/g and 600 Hz, respectively.