I have read the opposite,that size does indeed matter and that you will pass the larger stones after more flushes.
Since I have only completed four flushes I do not know for sure.
I did pass a marble sized stone which was brown this afternoon. when I dissected it it was yellowish transparent on the inside.