https://www.dataprep.jp/en/categories/how-to/ Recent content in How-to on Data Prep Toolbox Hugo -- gohugo.io en dataprep.jp https://www.dataprep.jp/en/how-to-use-data-wrangling/ Mon, 01 Jan 0001 00:00:00 +0000 https://www.dataprep.jp/en/how-to-use-data-wrangling/ <p>Here is a guide to the data wrangling tools available, organized by purpose.</p> <ul> <li><a class="link" href="#visually-cleanse-your-data" >Visually cleanse your data</a></li> <li><a class="link" href="#easily-merge-map-data-with-thematic-data" >Easily merge map data with thematic data</a></li> <li><a class="link" href="#quickly-understand-json-structure" >Quickly understand JSON structure</a></li> <li><a class="link" href="#fix-character-encoding-issues" >Fix character encoding issues</a></li> <li><a class="link" href="#easily-convert-addresses-to-latitudelongitude" >Easily convert addresses to latitude/longitude</a></li> <li><a class="link" href="#extract-table-data-from-pdfs" >Extract table data from PDFs</a></li> <li><a class="link" href="#remove-furigana-from-aozora-bunko-texts" >Remove furigana from Aozora Bunko texts</a></li> <li><a class="link" href="#use-mapbox-studio-base-maps-in-foursquare-studio-or-keplergl" >Use Mapbox Studio base maps in Foursquare Studio or Kepler.gl</a></li> <li><a class="link" href="#reduce-map-data-file-size" >Reduce map data file size</a></li> <li><a class="link" href="#quickly-create-buffer-zones-around-pois" >Quickly create buffer zones around POIs</a></li> <li><a class="link" href="#create-custom-map-data" >Create custom map data</a></li> <li><a class="link" href="#format-and-convert-map-data" >Format and convert map data</a></li> <li><a class="link" href="#convert-bus-route-data-to-network-data" >Convert bus route data to network data</a></li> <li><a class="link" href="#convert-svg-for-use-in-graphic-tools" >Convert SVG for use in graphic tools</a></li> </ul> <h2 id="visually-cleanse-your-data">Visually cleanse your data </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://open-refine.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_open-refine.jpg" alt="OpenRefine" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataviz.jp</div><div class="external-link-card__title">OpenRefine</div><div class="external-link-card__description">Data cleansing and transformation tool for tabular data</div><div class="external-link-card__url">open-refine.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="easily-merge-map-data-with-thematic-data">Easily merge map data with thematic data </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://geo-data-merger.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_geo-data-merger.jpg" alt="(Geo) DataMerger" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">(Geo) DataMerger</div><div class="external-link-card__description">Easily merge geographic data with thematic data</div><div class="external-link-card__url">geo-data-merger.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="quickly-understand-json-structure">Quickly understand JSON structure </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://jsoncrack.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_jsoncrack.png" alt="JSON Crack" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">JSON Crack</div><div class="external-link-card__description">Visually understand JSON data structures in your browser</div><div class="external-link-card__url">jsoncrack.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="fix-character-encoding-issues">Fix character encoding issues </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://change-character-encoding.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover-change-character-encoding.png" alt="Shift JIS ⇄ UTF-8 Converter" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Shift JIS ⇄ UTF-8 Converter</div><div class="external-link-card__description">Convert character encoding between Shift JIS and UTF-8</div><div class="external-link-card__url">change-character-encoding.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="easily-convert-addresses-to-latitudelongitude">Easily convert addresses to latitude/longitude </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://address-to-latlon.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_address-to-latlon.jpg" alt="Address to Lat/Lon Converter" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Address to Lat/Lon Converter</div><div class="external-link-card__description">Geocoding tool</div><div class="external-link-card__url">address-to-latlon.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="extract-table-data-from-pdfs">Extract table data from PDFs </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://tabula-pdf.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_tabula-pdf.jpg" alt="Tabula PDF" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Tabula PDF</div><div class="external-link-card__description">Extract table data from PDFs</div><div class="external-link-card__url">tabula-pdf.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="remove-furigana-from-aozora-bunko-texts">Remove furigana from Aozora Bunko texts </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://aozora-furigana.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_aozora-furigana.jpg" alt="Aozora Furigana Remover" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Aozora Furigana Remover</div><div class="external-link-card__description">Remove furigana and metadata from Aozora Bunko novels</div><div class="external-link-card__url">aozora-furigana.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="use-mapbox-studio-base-maps-in-foursquare-studio-or-keplergl">Use Mapbox Studio base maps in Foursquare Studio or Kepler.gl </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://classic-mapbox-styles.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_classic-mapbox-styles.png" alt="Mapbox Classic Styles" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Mapbox Classic Styles</div><div class="external-link-card__description">Mapbox map tiles for use with Kepler.gl and Foursquare Studio</div><div class="external-link-card__url">classic-mapbox-styles.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="reduce-map-data-file-size">Reduce map data file size </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://mapshaper.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_mapshaper.jpg" alt="Mapshaper" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Mapshaper</div><div class="external-link-card__description">Process and convert map data</div><div class="external-link-card__url">mapshaper.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="quickly-create-buffer-zones-around-pois">Quickly create buffer zones around POIs </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://turf-buffer.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_turf-buffer.png" alt="Turf Buffer" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Turf Buffer</div><div class="external-link-card__description">Easily create radius buffers in your browser</div><div class="external-link-card__url">turf-buffer.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="create-custom-map-data">Create custom map data </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://geojson.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_geojson.jpg" alt="GeoJSON.io" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">GeoJSON.io</div><div class="external-link-card__description">Trace map tiles to create GeoJSON</div><div class="external-link-card__url">geojson.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="format-and-convert-map-data">Format and convert map data </h2><p><div class="external-link-card"> <a class="external-link-card__inner" href="https://latlon-formatter.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_latlon-formatter.png" alt="Lat/Lon Formatter" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Lat/Lon Formatter</div><div class="external-link-card__description">Easily convert latitude/longitude decimal places</div><div class="external-link-card__url">latlon-formatter.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <div class="external-link-card"> <a class="external-link-card__inner" href="https://transform-coordinates.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_transform-coordinates.png" alt="Transform Coordinates" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">Transform Coordinates</div><div class="external-link-card__description">Convert coordinates of geographic feature files</div><div class="external-link-card__url">transform-coordinates.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> </p> <h2 id="convert-bus-route-data-to-network-data">Convert bus route data to network data </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://gtfs-to-network.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/gtfs-to-network.png" alt="GTFS to Network" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">GTFS to Network</div><div class="external-link-card__description">Convert GTFS transit data to network data</div><div class="external-link-card__url">gtfs-to-network.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div> <h2 id="convert-svg-for-use-in-graphic-tools">Convert SVG for use in graphic tools </h2><div class="external-link-card"> <a class="external-link-card__inner" href="https://geojson-and-svg.dataprep.jp/" target="_blank" rel="noopener noreferrer"> <div class="external-link-card__media"><img src="https://www.dataprep.jp/images/cover_geojson-and-svg.jpg" alt="SVG ⇄ GeoJSON Converter" loading="lazy" decoding="async" /></div> <div class="external-link-card__body"><div class="external-link-card__site">dataprep.jp</div><div class="external-link-card__title">SVG ⇄ GeoJSON Converter</div><div class="external-link-card__description">Convert between GeoJSON and SVG formats</div><div class="external-link-card__url">geojson-and-svg.dataprep.jp</div></div> <span class="external-link-card__icon" aria-hidden="true"> <svg viewBox="0 0 24 24" focusable="false"> <path d="M14 3h7v7m0-7L13 11" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> <path d="M17 17H5V5h7" fill="none" stroke="currentColor" stroke-width="1.5" stroke-linecap="round" stroke-linejoin="round"/> </svg> </span> </a> </div>