Chronic low back pain (CLBP) has become more prominent with globally increasing life expectancy. Its cause is more attributable to degenerative changes than to traumatic lesions. Although the diagnosis of CLBP is recently on higher demand, lack of clinical features and non-informative imaging findings in patients with CLBP are challenging to clinicians to establish the diagnosis. Therefore, understanding of the new concept of pathogenesis, elimination of prejudice, and evidence-based diagnostic steps are required to resolve the question of pain source. Analysis of pain distribution patterns and careful history taking can be utilized as an initial guide to divide CLBP into somatic and radicular pain. Zygapophyseal joint pain and sacroiliac joint pain representing somatic pain can be further investigated using medial branch and sacroiliac joint blocks. However, comparative blocks are essential to decreased false positive rate. Infiltration of a small volume of local anesthetics can increase the specificity of the procedures. Discogenic pain stemming from internal disk derangement can be confirmed by pressure-controlled discography. Automated discography is recommended to provide the constant rate of dye injection with obviating the fluctuation of intradiscal pressure. Evidence-based concept and diagnostic procedures can provide more accurate and efficient methods to establish the diagnosis of CLBP.