You're missing a hopper. You need to put the line of hoppers bringing the items to the sorter one block higher. Sorters work by locking off hoppers so they can't move items, allowing them to flow past the sorter instead of into it.
I don't see any possible way for that to sort items. How is that supposed to work?
An item sorter normally consists of:
1. Feeder system (usually water or a hopper pipe).
2. Filter hopper with the item you want to sort in the far left slot and 4 space saver/filler items
3. Loading hopper, which takes the filtered items and puts them into a chest.
4. Redstone circuit to make it all work.
Example of basic item sorter.
Top hopper is the feeder that supplies the unsorted items to the system.
Middle hopper is the item filter that pulls the desired item from the feeder system.
Bottom hopper then takes the sorted item and loads it into a chest.
Filter hopper must be facing away from other hoppers or chests (simplest is to face it into the comparator).
Filter hopper contains the desired item in the far left slot, and 4 space saver-filler items in the other 4 slots. Space saver items in this basic design should be items that only stack to 16 (like signs, snowballs or eggs, although you only use 1 in each slot). Also, they should not be anything you will be sorting anywhere in the system. A simple way to get unique items is to rename the items used in the 4 right slots.
This basic structure is then tiled to accommodate as many items as you need to sort. The basic item sorter is economical because it only holds 7 items in the filter system, but if too many items are fed into the filter, or the storage chest fills up, the item sorter will break.
An alternate design that is overflow-proof extends the redstone signal by an additional block and uses items that stack to 64 in the 4 right space saver slots (again, only 1 item in each of the 4 right slots). The overflow-proof design holds 42 items in the filter system, so it's most useful on high output farms.
Overflow-proof item sorter.
Tiled item sorters: basic on left, overflow-proof on right (with alternate chest placement for more storage capacity).
Note that the feeder hoppers are a hopper pipe moving items over the top of the filter hoppers (could also be water, droppers, etc.). Also note that last "sorter" is just an unsorted item catch-all chest for anything not in the sorter/filter system (anything that reaches the end of the sorter chain is just pushed into the last chest).