Extracting line segments from a hough transform

How can I detect line segments instead of lines in an image after performing a Hough Transform? Does it make sense to save the minimum and maximum coordinates for each accumulator bin or is there a better way?

I'm not using OpenCV, btw.