Elderly with chronic neck pain (CNP) showed impaired dynamic balance as indicated by longer duration during the Timed Up and Go (TUG) test. TUG contains several components including sit-to-stand (STS), walk, turn, turn-to-sit (TTS), but it is unclear which component of TUG was markedly impaired in the elderly with chronic neck pain (CNP). This study aimed to identify which component of the Timed Up and Go test was impaired in elderly with CNP as compared with those without neck pain. This cross-sectional study compared the duration used to complete the TUG task between 21 healthy elderly aged 64.57 ± 4.03 years and 15 elderly with CNP aged 64.00 ± 4.05 years. Each TUG component was identified by using inertial sensors attached to the body. The elderly with CNP were classified further into mild and moderate disability using the Neck Disability Index. The duration of STS, TTS, and total TUG were significantly longer in CNP with mild disability (p <0.05). CNP with moderate disability showed larger peak angular trunk velocity in all TUG components than healthy and CNP with mild CNP. The STS and TTS components of the TUG test were markedly impaired in elderly with chronic neck pain. Those impairments can be reflected by the longer duration of STS and TTS components or larger peak angular trunk velocity.