Railway authorities say they are investigating the accident, which happened in Yilan County at about 16:50 local time (08:50 GMT) on Sunday.
A total of 366 passengers were on the train when all eight of its carriages derailed. All have been accounted for.
The incident is Taiwan's worst rail accident in 27 years. At least three children were among the dead.
"The train was going very fast. I hit a wall when the car started to flip. Around five to six people were thrown out of the carriage door," passenger Henry Tseng told Reuters news agency.
"There [was] no time to think what happened. Everyone was in a rush to get out."
The Puyuma Express 6432 service came off the tracks close to Xinma station, near the town of Su'ao about 70km (43 miles) from Taipei.
It was travelling between Taipei and the eastern county of Taitung.
"There are four carriages that were overturned at 90 degrees and the worst casualties were in those carriages," said Jason Lu, head of the Taiwan Railways Administration (TRA).
The deputy chief of the TRA, Lu Chieh-shen, earlier told a press conference that the train was only six years old and had been in "pretty good condition" before the accident.
It remains unclear what caused the train to derail, but witnesses told local media they heard a loud noise then sparks and smoke.
Video footage on local television showed passengers breaking windows to escape the carriages.
"I smashed the safety glass and crawled out and I helped to pull a young man out," one passenger had told reporters. "There was a person sitting behind me. I'm not sure she survived."
Copyright © 2017-2099
Chengdu Sino Beverage Machinery Co., Ltd. All Rights Reserved
Web visiting with 1024*768 resolution is strongly recommended
Site links: Sinobema China Ministry of Commerce CCPIT 施诺机械设备有限公司(中国)