I generally get 8-10 sticks out of a fill.
Dont know which model you have but my bet is its on the fill method. This is perhaps the largest contributor to short fill times.
When filling the lighter invert it and hold down the button as if burning a flame. You don't want it lit but you do want the valve to be open to expel gas so liquid can fill the space.