Generally, there is a small accuracy loss after quantization, but for some networks such as Mobilenets, the accuracy loss can be large. In this situation, quantize finetuning can be used to further improve the accuracy of quantized models.
There are three APIs for quantize finetuning in the Python package,
tf.contrib.decent_q.