Pixel sort threshold is everything. Sorting the WHOLE image is why yours looks like a candy smear.
Pixel sorting isn't 'sort all the pixels'. That just melts the image into vertical rainbow drips. The art is in the threshold — you only sort within intervals defined by a brightness/hue mask.
The algorithm, plainly:
Pick a direction (rows or columns).
Walk each line. Start a 'sortable interval' when a pixel's brightness crosses your lower threshold, end it when it crosses the upper.
Sort ONLY the pixels inside each interval (by brightness, or hue, or saturation — different feel each).
Leave everything outside the thresholds untouched.
The untouched regions are what keep the image readable. A face stays a face, but her hair becomes these gorgeous sorted streaks because the hair tones fell inside the interval. Tight thresholds = subtle surgical sorting. Wide = candy smear.
Sort by hue for a different, more psychedelic feel. Sort by saturation for a weird 'color leak' look. Brightness is the classic.