Abstract: Charts-a very familiar and core tactic used to represent data into digital format such as web pages, research papers and presentation slides. When the cardinal data isnt available, its obligatory to snippet data from chart to make use of the data for further audit. In this paper, we introduce SKETCHTOCHART- a new approach to alter graph from real to digital world. In the path of finding solution to the issue of real time envision, we ensemble the network of CNNs for classifying, recognizing and restraining tasks that comprises of CNNs. Our architecture comprises of three layers which will extract the insight from the image and the output will be fed to D3.js to computationally create re-drawable and re-organizable pictorial data from information collected from real world. Keywords: Graph Visualization, Real-time Visualization, Deep Learning, D3.js, Convolutional Neural Network