{"id":14010,"date":"2023-08-23T05:03:56","date_gmt":"2023-08-23T09:03:56","guid":{"rendered":"https:\/\/www.shinetechsoftware.com\/?p=14010"},"modified":"2023-08-30T00:31:54","modified_gmt":"2023-08-30T04:31:54","slug":"history-and-development-of-gpt","status":"publish","type":"post","link":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/","title":{"rendered":"History and Development of GPT"},"content":{"rendered":"\t\t<div data-elementor-type=\"wp-post\" data-elementor-id=\"14010\" class=\"elementor elementor-14010\" data-elementor-post-type=\"post\">\n\t\t\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-e01c5a4 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"e01c5a4\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-7a7d47b\" data-id=\"7a7d47b\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-692289e elementor-widget elementor-widget-heading\" data-id=\"692289e\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h1 class=\"elementor-heading-title elementor-size-default\">History and Development of <span class=\"font-red\">ChatGPT <\/span><\/h1>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-ed38cdf elementor-widget elementor-widget-image\" data-id=\"ed38cdf\" data-element_type=\"widget\" data-widget_type=\"image.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t<img fetchpriority=\"high\" decoding=\"async\" width=\"1024\" height=\"623\" src=\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt-1024x623.jpg\" class=\"attachment-large size-large wp-image-14147\" alt=\"ChatGPT\" srcset=\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt-1024x623.jpg 1024w, https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt-300x183.jpg 300w, https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt-768x467.jpg 768w, https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg 1200w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/>\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-58b807b elementor-widget elementor-widget-text-editor\" data-id=\"58b807b\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>From the <strong><a href=\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/what-exactly-is-chatgpt\/\">Previous Article<\/a><\/strong>, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?<\/p><p>The development of the GPT model can be traced back to 2018 and has undergone several versions of improvements and extensions. The following is the release time, number of parameters, and main features of each version of GPT:<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-c773840 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"c773840\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-9aa1915\" data-id=\"9aa1915\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-66b0a27 elementor-widget elementor-widget-heading\" data-id=\"66b0a27\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-large\">GPT-1:<span class=\"font-red\"> June 2018<\/span> <\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-441d1f7 elementor-widget elementor-widget-text-editor\" data-id=\"441d1f7\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span data-preserver-spaces=\"true\"><strong>Number of published parameters<\/strong>: 117 million<\/span><\/p><p><strong><span data-preserver-spaces=\"true\">Features:<\/span><\/strong><span data-preserver-spaces=\"true\">\u00a0GPT-1 is the first GPT version, which adopts Transformer-based autoregressive language model architecture and has achieved excellent performance in various natural language processing tasks through unsupervised pre-training and supervised fine-tuning methods.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-cfc1237 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"cfc1237\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-e350a75\" data-id=\"e350a75\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-b45c913 elementor-widget elementor-widget-heading\" data-id=\"b45c913\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-large\">GPT-2:<span class=\"font-red\"> February 2019<\/span> <\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-b01533c elementor-widget elementor-widget-text-editor\" data-id=\"b01533c\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span data-preserver-spaces=\"true\"><strong>Number of published parameters<\/strong>: 1.5 billion<\/span><\/p><p><strong><span data-preserver-spaces=\"true\">Features:<\/span><\/strong><span data-preserver-spaces=\"true\">\u00a0Compared with GPT-1, the number of parameters of GPT-2 has been dramatically improved, and the generation ability of the model has also been significantly enhanced. GPT-2 can generate high-quality articles and stories, but its generative solid power raises ethical and safety issues. Therefore, OpenAI adopted a phased strategy when releasing GPT-2.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-46375bd elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"46375bd\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-6121987\" data-id=\"6121987\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-cb933fd elementor-widget elementor-widget-heading\" data-id=\"cb933fd\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-large\">GPT-3:<span class=\"font-red\"> May 2020<\/span> <\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1a4df36 elementor-widget elementor-widget-text-editor\" data-id=\"1a4df36\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span data-preserver-spaces=\"true\"><strong>Number of published parameters<\/strong>: 175 billion<\/span><\/p><p><strong><span data-preserver-spaces=\"true\">Features:<\/span><\/strong><span data-preserver-spaces=\"true\">\u00a0The number of parameters is more than 100 times that of GPT-2, and its performance is close to the human level on many tasks. GPT-3 performs well on natural language understanding, generation, and summarization tasks. However, the large model size makes training and inference costs high. To allow more people to use GPT-3, OpenAI launched the OpenAI API based on cloud services. <\/span><\/p><p><span data-preserver-spaces=\"true\">In 2022, based on GPT-3, openAI will use a more extensive data set and a more complex model to train a large-scale language model GPT-3.5. Based on GPT-3.5, the language model trained for dialogue is ChatGPT. It was released on November 30, 2022. Two months later, monthly active users exceeded 100 million, becoming the fastest-growing number of users in history\u2014consumer applications.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-12a5758 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"12a5758\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-69577b6\" data-id=\"69577b6\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c09d117 elementor-widget elementor-widget-heading\" data-id=\"c09d117\" data-element_type=\"widget\" data-widget_type=\"heading.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t<h2 class=\"elementor-heading-title elementor-size-large\">GPT-4:<span class=\"font-red\"> March, 2023<\/span> <\/h2>\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-a4f74c1 elementor-widget elementor-widget-text-editor\" data-id=\"a4f74c1\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p><span data-preserver-spaces=\"true\"><strong>Number of parameters<\/strong>: 1.6 trillion<\/span><\/p><p><strong><span data-preserver-spaces=\"true\">Features:<\/span><\/strong><span data-preserver-spaces=\"true\">\u00a0The number of parameters of GPT-4 is 16 times that of GPT-3. The accuracy of GPT-4&#8217;s answers is significantly improved, has a higher image recognition ability, and can generate lyrics and creative texts to achieve style changes. In addition, the text input limit of GPT-4 has also been increased to 25,000 characters, and there are more optimizations for languages other than English.<\/span><\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-47b7d30 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"47b7d30\" data-element_type=\"section\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t\t\t\t\t<div class=\"elementor-background-overlay\"><\/div>\n\t\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-e6e6650\" data-id=\"e6e6650\" data-element_type=\"column\" data-settings=\"{&quot;background_background&quot;:&quot;classic&quot;}\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-fd39662 elementor-widget elementor-widget-text-editor\" data-id=\"fd39662\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<p>There is a shocking rumor: GPT-4 passed the Turing test!<\/p><p>GPT-4 passing the Turing test means that it has achieved such a high level of performance on natural language processing tasks that it is difficult for humans to distinguish whether humans write the text it generates. This proves that GPT-4&#8217;s ability to understand and develop natural language has approached or reached human levels. It has high application potential in many fields, such as automatic question answering, machine translation, article summarization, natural language generation, etc.<\/p><p>At the same time, this also shows that GPT-4 can improve the efficiency and quality of natural language processing, bringing more possibilities for future development. At the same time, it is also possible to understand the picture, not to talk about the content that is not allowed and the sensitive content.<\/p>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<section class=\"elementor-section elementor-top-section elementor-element elementor-element-a91c339 elementor-section-boxed elementor-section-height-default elementor-section-height-default\" data-id=\"a91c339\" data-element_type=\"section\">\n\t\t\t\t\t\t<div class=\"elementor-container elementor-column-gap-default\">\n\t\t\t\t\t<div class=\"elementor-column elementor-col-100 elementor-top-column elementor-element elementor-element-2440970\" data-id=\"2440970\" data-element_type=\"column\">\n\t\t\t<div class=\"elementor-widget-wrap elementor-element-populated\">\n\t\t\t\t\t\t<div class=\"elementor-element elementor-element-c4ccaa9 elementor-hidden-mobile elementor-widget elementor-widget-text-editor\" data-id=\"c4ccaa9\" data-element_type=\"widget\" data-widget_type=\"text-editor.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t\t\t\t\t<h2 class=\"top-title text-center hire-bottom-width\" style=\"text-align: center;font-size: 44px; font-weight: 800;\">Are you ready to hire our developers?<br>\n<span class=\"font-red\">Contact us!<\/span><\/h2>\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<div class=\"elementor-element elementor-element-1c102bf elementor-widget elementor-widget-shinetech-form\" data-id=\"1c102bf\" data-element_type=\"widget\" data-widget_type=\"shinetech-form.default\">\n\t\t\t\t<div class=\"elementor-widget-container\">\n\t\t\t        \n<script>\n    window.onload = function() {\n        addGclid();\n    }\n\n    function addGclid() {\n        var gclidParam = getParam('gclid');\n        var gclidFormFields = ['gclid_field', 'foobar']; \/\/ \u6b64\u5904\u4e3a\u6240\u6709\u53ef\u80fd\u7684 GCLID \u8868\u5355\u5b57\u6bb5\n        var gclidRecord = null;\n        var currGclidFormField;\n\n        var gclsrcParam = getParam('gclsrc');\n        var isGclsrcValid = !gclsrcParam || gclsrcParam.indexOf('aw') !== -1;\n\n        gclidFormFields.forEach(function(field) {\n            if (document.getElementById(field)) {\n                currGclidFormField = document.getElementById(field);\n            }\n        });\n\n        if (gclidParam && isGclsrcValid) {\n            gclidRecord = getExpiryRecord(gclidParam);\n            localStorage.setItem('gclid', JSON.stringify(gclidRecord));\n        }\n\n        var gclid = gclidRecord || JSON.parse(localStorage.getItem('gclid'));\n        var isGclidValid = gclid && new Date().getTime() < gclid.expiryDate;\n\n        if (currGclidFormField && isGclidValid) {\n            currGclidFormField.value = gclid.value;\n        }\n    }\n\n    \/\/ google-Ads trace start\n    function getParam(p) {\n        var match = RegExp('[?&]' + p + '=([^&]*)').exec(window.location.search);\n        return match && decodeURIComponent(match[1].replace(\/\\+\/g, ' '));\n    }\n\n    function getExpiryRecord(value) {\n        var expiryPeriod = 90 * 24 * 60 * 60 * 1000; \/\/ \u4ee5\u6beb\u79d2\u8ba1\u7684 90 \u5929\u6709\u6548\u671f\n\n        var expiryDate = new Date().getTime() + expiryPeriod;\n        return {\n            value: value,\n            expiryDate: expiryDate\n        };\n    }\n<\/script>\n\n<div class=\"form-wrapper\">\n    <form class=\"contact-form needs-validation\" method=\"post\" novalidate>\n        <input type=\"hidden\" id=\"gclid_field\" name=\"gclid_field\" value=\"\">\n        <input type=\"hidden\" id=\"page-title\" name=\"page_title\" value=\"History and Development of GPT\">\n        <input type=\"hidden\" id=\"_nounce\" name=\"_nounce\" value=\"8961ce790d\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/en\/wp-json\/wp\/v2\/posts\/14010\" \/>        <div class=\"container px-0\">\n            <div class=\"row\">\n                <div class=\"col-sm-6 col-md-6 col-lg-6\">\n                    <div class=\"form-material\">\n                        <input type=\"text\" class=\"form-material__control\" name=\"contact\" required id=\"contact_name\">\n                        <label class=\"form-material__label\" for=\"contact\">Name*<\/label>\n                        <div class=\"invalid-feedback\">\n                            Please fill require field.\n                        <\/div>\n                    <\/div>\n                <\/div>\n                <div class=\"col-sm-6 col-md-6 col-lg-6\">\n                    <div class=\"form-material\">\n                        <input class=\"form-material__control\" name=\"email\" type=\"email\" id=\"email\" required>\n                        <label class=\"form-material__label\" for=\"email\">Email*<\/label>\n                        <div class=\"invalid-feedback\">\n                            Please fill a valid Email.\n                        <\/div>\n                    <\/div>\n                <\/div>\n                <div class=\"col-sm-6 col-md-6 col-lg-6\">\n                    <div class=\"form-material\">\n                        <input type=\"text\" class=\"form-material__control\" name=\"telephone\" id=\"telephone\" required>\n                        <label class=\"form-material__label\" for=\"telephone\">Telephone* <\/label>\n                        <div class=\"invalid-feedback\">\n                            Please fill require field.\n                        <\/div>\n                    <\/div>\n                <\/div>\n                <div class=\"col-sm-6 col-md-6 col-lg-6\">\n                    <div class=\"form-material\">\n                        <input type=\"text\" class=\"form-material__control\" name=\"company\" id=\"company\">\n                        <label class=\"form-material__label\" for=\"company\">Company Name <\/label>\n                        <div class=\"invalid-feedback\">\n                            Please fill require field.\n                        <\/div>\n                    <\/div>\n                <\/div>\n                <div class=\"col-sm-12 col-md-12 col-lg-12\">\n                    <div class=\"form-material\">\n                        <textarea rows=\"8\" style=\"min-height: 130px;\" class=\"form-material__control\" name=\"description\" id=\"desc\" required><\/textarea>\n                        <label class=\"form-material__label\" for=\"description\">What do you need?*<\/label>\n                        <div class=\"invalid-feedback\">\n                            Please fill require field.\n                        <\/div>\n                    <\/div>\n                <\/div>\n            <\/div>\n            <div class=\"row contact-footer\">\n                <div class=\"col-sm-6 col-md-6 col-lg-6\">\n                    <button id=\"submit\" type=\"submit\" class=\"btn btn-primary\">\n                        Submit Request\n                    <\/button>\n                <\/div>\n                <div class=\"col-sm-6 col-md-6 col-lg-6 \">\n                    <div class=\"form-material form-check-group\">\n                        <input class=\"form-check-input contact-option\" id=\"freeTrial\" name=\"freetrial\" type=\"checkbox\" value=\"[FreeTrial]\">\n                        <label class=\"form-check-label\" for=\"freeTrial\">\n                            I would like a <a class=\"free-trial-link\" href=\"https:\/\/shinetechchina.com.cn\/en\/free-trial\/\">free trial<\/a>\n                        <\/label>\n                    <\/div>\n                <\/div>\n\n            <\/div>\n        <\/div>\n    <\/form>\n<\/div>        \t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"<p>From the Previous Article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?<\/p>\n","protected":false},"author":6,"featured_media":14147,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[19],"tags":[],"class_list":["post-14010","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-our-insight"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v23.9 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>History and Development of GPT | Shinetech Software<\/title>\n<meta name=\"description\" content=\"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"History and Development of GPT | Shinetech Software\" \/>\n<meta property=\"og:description\" content=\"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?\" \/>\n<meta property=\"og:url\" content=\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\" \/>\n<meta property=\"og:site_name\" content=\"Shinetech Software\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/ShinetechSoftware\" \/>\n<meta property=\"article:published_time\" content=\"2023-08-23T09:03:56+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-30T04:31:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"730\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Shinetech Editorial Group\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@ShinetechUS\" \/>\n<meta name=\"twitter:site\" content=\"@ShinetechUS\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Shinetech Editorial Group\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\"},\"author\":{\"name\":\"Shinetech Editorial Group\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/person\/bdf7ec41209ddf528d4fd8a5902baf90\"},\"headline\":\"History and Development of GPT\",\"datePublished\":\"2023-08-23T09:03:56+00:00\",\"dateModified\":\"2023-08-30T04:31:54+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\"},\"wordCount\":567,\"publisher\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#organization\"},\"image\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg\",\"articleSection\":[\"Our Insight\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\",\"name\":\"History and Development of GPT | Shinetech Software\",\"isPartOf\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg\",\"datePublished\":\"2023-08-23T09:03:56+00:00\",\"dateModified\":\"2023-08-30T04:31:54+00:00\",\"description\":\"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?\",\"breadcrumb\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg\",\"contentUrl\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg\",\"width\":1200,\"height\":730,\"caption\":\"ChatGPT\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/shinetechchina.com.cn\/en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"History and Development of GPT\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#website\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/\",\"name\":\"Shinetech Software\",\"description\":\"Shinetech Software\",\"publisher\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/shinetechchina.com.cn\/en\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#organization\",\"name\":\"Shinetech Software\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2021\/08\/Logo.svg\",\"contentUrl\":\"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2021\/08\/Logo.svg\",\"width\":170,\"height\":40,\"caption\":\"Shinetech Software\"},\"image\":{\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/ShinetechSoftware\",\"https:\/\/x.com\/ShinetechUS\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/person\/bdf7ec41209ddf528d4fd8a5902baf90\",\"name\":\"Shinetech Editorial Group\",\"url\":\"https:\/\/shinetechchina.com.cn\/en\/author\/richard-liu\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"History and Development of GPT | Shinetech Software","description":"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"og_locale":"en_US","og_type":"article","og_title":"History and Development of GPT | Shinetech Software","og_description":"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?","og_url":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/","og_site_name":"Shinetech Software","article_publisher":"https:\/\/www.facebook.com\/ShinetechSoftware","article_published_time":"2023-08-23T09:03:56+00:00","article_modified_time":"2023-08-30T04:31:54+00:00","og_image":[{"width":1200,"height":730,"url":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg","type":"image\/jpeg"}],"author":"Shinetech Editorial Group","twitter_card":"summary_large_image","twitter_creator":"@ShinetechUS","twitter_site":"@ShinetechUS","twitter_misc":{"Written by":"Shinetech Editorial Group","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#article","isPartOf":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/"},"author":{"name":"Shinetech Editorial Group","@id":"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/person\/bdf7ec41209ddf528d4fd8a5902baf90"},"headline":"History and Development of GPT","datePublished":"2023-08-23T09:03:56+00:00","dateModified":"2023-08-30T04:31:54+00:00","mainEntityOfPage":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/"},"wordCount":567,"publisher":{"@id":"https:\/\/shinetechchina.com.cn\/en\/#organization"},"image":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage"},"thumbnailUrl":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg","articleSection":["Our Insight"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/","url":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/","name":"History and Development of GPT | Shinetech Software","isPartOf":{"@id":"https:\/\/shinetechchina.com.cn\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage"},"image":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage"},"thumbnailUrl":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg","datePublished":"2023-08-23T09:03:56+00:00","dateModified":"2023-08-30T04:31:54+00:00","description":"From the previous article, we already know that GPT (Generative Pre-trained Transformer) needs a lot of data training to ensure the correct operation of the model. So, how did the well-known GPT-3.5 or GPT-4 develop? Or, what has GPT experienced in the development process?","breadcrumb":{"@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#primaryimage","url":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg","contentUrl":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2023\/08\/64063dbcad97bd421b437096_chatgpt.jpg","width":1200,"height":730,"caption":"ChatGPT"},{"@type":"BreadcrumbList","@id":"https:\/\/shinetechchina.com.cn\/en\/our-insight\/history-and-development-of-gpt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/shinetechchina.com.cn\/en\/"},{"@type":"ListItem","position":2,"name":"History and Development of GPT"}]},{"@type":"WebSite","@id":"https:\/\/shinetechchina.com.cn\/en\/#website","url":"https:\/\/shinetechchina.com.cn\/en\/","name":"Shinetech Software","description":"Shinetech Software","publisher":{"@id":"https:\/\/shinetechchina.com.cn\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/shinetechchina.com.cn\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/shinetechchina.com.cn\/en\/#organization","name":"Shinetech Software","url":"https:\/\/shinetechchina.com.cn\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/logo\/image\/","url":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2021\/08\/Logo.svg","contentUrl":"https:\/\/shinetechchina.com.cn\/en\/wp-content\/uploads\/2021\/08\/Logo.svg","width":170,"height":40,"caption":"Shinetech Software"},"image":{"@id":"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/ShinetechSoftware","https:\/\/x.com\/ShinetechUS"]},{"@type":"Person","@id":"https:\/\/shinetechchina.com.cn\/en\/#\/schema\/person\/bdf7ec41209ddf528d4fd8a5902baf90","name":"Shinetech Editorial Group","url":"https:\/\/shinetechchina.com.cn\/en\/author\/richard-liu\/"}]}},"_links":{"self":[{"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/posts\/14010","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/comments?post=14010"}],"version-history":[{"count":13,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/posts\/14010\/revisions"}],"predecessor-version":[{"id":15393,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/posts\/14010\/revisions\/15393"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/media\/14147"}],"wp:attachment":[{"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/media?parent=14010"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/categories?post=14010"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/shinetechchina.com.cn\/en\/wp-json\/wp\/v2\/tags?post=14010"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}