{"id":649,"date":"2023-02-03T14:47:52","date_gmt":"2023-02-03T14:47:52","guid":{"rendered":"https:\/\/public.ksc.nasa.gov\/mns\/?page_id=649"},"modified":"2024-07-19T14:24:51","modified_gmt":"2024-07-19T18:24:51","slug":"ms-development","status":"publish","type":"page","link":"https:\/\/public.ksc.nasa.gov\/mns\/ms-development\/","title":{"rendered":"M&S Development"},"content":{"rendered":"\n
<\/span>\"NASA
\n

M&S Development<\/h1><\/div>\n<\/div><\/div>\n\n\n\n

<\/p>\n\n\n\n

Bolded <\/strong>words or phrases are key terms or acronyms defined under References or concepts discussed in NASA-STD-7009 or NASA-HDBK-7009.<\/em><\/p>\n\n\n\n

While the Pre-A Phase of the M&S Life Cycle<\/a> is essentially getting things started for M&S Development, the major efforts in development start in Phase A, which picks up the preliminary information gathered in Model Initiation and finalizes the M&S\u2019s requirements for M&S design.<\/p>\n\n\n\n

\"Development<\/figure>\n\n\n\n

The details of model design, in the form of conceptual models<\/strong>, possible drawings, etc., are accomplished and reviewed (i.e., conceptually validated<\/strong>) in Phase B, prior to implementation in Phase C. When implementation is completed, testing of the M&S in Phase D consists of first verification<\/strong>, then empirical validation<\/strong>, and, when successfully completed, the model is released.<\/p>\n\n\n\n

The permissible uses<\/strong> (i.e., formal statement of M&S uses (limits of operation<\/strong> or use) as determined during development and testing) accompanies the M&S upon release, which should be included in the M&S User\u2019s Guide<\/a> along with assumptions and criteria for use. NASA-HDBK-7009<\/a>, Appendix C, shows a content outline for an M&S User\u2019s Guide.<\/p>\n\n\n\n

NASA M&S Development References:<\/em><\/p>\n\n\n\n
Topic<\/strong><\/td>NASA-STD-7009A<\/strong><\/td>NASA-HDBK-7009A<\/strong><\/td><\/tr>
M&S Development <\/td>Section 4.2<\/td>Sections 4.6, 5 \u2013 5.5<\/td><\/tr>
M&S User\u2019s Guide<\/td> <\/td>Appendix C <\/td><\/tr><\/tbody><\/table>\n\n\n\n

<\/p>\n\n\n\n

M&S User\u2019s Guide Content<\/strong><\/h3>\n\n\n\n

1. General Information<\/strong><\/p>\n\n\n\n

    \n
  1. Table of Contents, Figures, and Tables.<\/li>\n\n\n\n
  2. User\u2019s Guide Revision History.<\/li>\n\n\n\n
  3. Model applicable glossary.<\/li>\n\n\n\n
  4. Model applicable acronyms.<\/li>\n\n\n\n
  5. Model applicable references.<\/li>\n<\/ol>\n\n\n\n

    2. Model Identification<\/strong><\/p>\n\n\n\n

      \n
    1. Official model name (or designator).<\/li>\n\n\n\n
    2. Applicable revision.<\/li>\n\n\n\n
    3. Description of model.<\/li>\n\n\n\n
    4. Location of the model and relevant artifacts repository.<\/li>\n<\/ol>\n\n\n\n

      3. Intended Use<\/strong> (see section 5.1.1.2 of this NASA Technical Handbook)<\/p>\n\n\n\n

        \n
      1. What the model is.<\/li>\n\n\n\n
      2. What the model is used for (i.e., its purpose).<\/li>\n\n\n\n
      3. What the model should not be used for.<\/li>\n<\/ol>\n\n\n\n

        4. M&S Conceptual Diagram<\/strong> (Conceptual Model)<\/p>\n\n\n\n

          \n
        1. Model Contents.<\/li>\n\n\n\n
        2. Sequence of Processes & Computations (as needed).<\/li>\n\n\n\n
        3. Description of Model Capabilities.<\/li>\n\n\n\n
        4. Sources and General Description of Key Equations and Systems of Equations to use (or used) in the model; especially those most critical to modeling the RWS or those that could prove difficult to implement.<\/li>\n<\/ol>\n\n\n\n

          5. Technical Background of How the Model Works<\/strong><\/p>\n\n\n\n

            \n
          1. M&S Architectural Diagram.<\/li>\n\n\n\n
          2. Primary Governing Concepts (possibly equations and systems of equations), along with their pedigree of use.<\/li>\n\n\n\n
          3. M&S Abstractions & Assumptions.<\/li>\n\n\n\n
          4. How uncertainties are handled in\n
              \n
            1. The construction of the model.<\/li>\n\n\n\n
            2. The use of the model.\n
                \n
              1. In the Input.<\/li>\n\n\n\n
              2. In the Output.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<\/li>\n\n\n\n
              3. Technical Metrics\n
                  \n
                1. Accuracy and Precision of the Released Model.<\/li>\n\n\n\n
                2. Model Setup criteria to obtain desired level of accuracy or precision.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                3. User Interface.<\/li>\n<\/ol>\n\n\n\n

                  6. Permissible Uses of the Model, as constrained by<\/strong><\/p>\n\n\n\n

                    \n
                  1. The Intended Use.<\/li>\n\n\n\n
                  2. Limits of Operation (boundary conditions for model use):
                    1. As Designed, determined by:<\/li><\/ol>\n
                        \n
                      1. Assumptions.<\/li>\n\n\n\n
                      2. Modeling choices.<\/li>\n\n\n\n
                      3. As Verified.<\/li>\n\n\n\n
                      4. As Validated.<\/li>\n\n\n\n
                      5. Include Obsolescence Criteria.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n\n\n\n

                        7. Processes for Model Use<\/strong><\/p>\n\n\n\n

                          \n
                        1. Model Use\/Analysis Plan.\n
                            \n
                          1. Suggestions from a \u201cmodel perspective\u201d of what to include in the Use\/Analysis Plan, with the Developer\u2019s Scope of Use in mind.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                          2. Use Assessment.<\/li>\n\n\n\n
                          3. Setup.\n
                              \n
                            1. M&S Architectural Diagram.<\/li>\n\n\n\n
                            2. Requirements and Instructions for setting up (installing) the model for use.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                            3. Inputs.\n
                                \n
                              1. What all the inputs are.<\/li>\n\n\n\n
                              2. What the permissible range for each input is.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                              3. User Interface.<\/li>\n\n\n\n
                              4. Use.<\/li>\n<\/ol>\n\n\n\n

                                8. Expected Results from Use<\/strong><\/p>\n\n\n\n

                                  \n
                                1. Example Results (Samples).<\/li>\n\n\n\n
                                2. Comparison with referent empirical data.
                                  Provide examples of results with good and poor comparison to referent data.<\/li>\n\n\n\n
                                3. Uncertainties with upper and lower bounds in the overlay of plotted data.\n
                                    \n
                                  1. Associated input uncertainties with their pedigree.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                                  2. Potential Areas of Sensitivity.<\/li>\n<\/ol>\n\n\n\n

                                    9. Other M&S Development Information Relevant to M&S Use<\/strong><\/p>\n\n\n\n

                                      \n
                                    1. Potential Caveats.\n
                                        \n
                                      1. Unachieved Acceptance Criteria.<\/li>\n\n\n\n
                                      2. Waivers to Development Requirements.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                                      3. Development Related Credibility Factors\n
                                          \n
                                        1. Data Pedigree.<\/li>\n\n\n\n
                                        2. Verification.<\/li>\n\n\n\n
                                        3. Validation.<\/li>\n\n\n\n
                                        4. M&S (Revision) History.<\/li>\n\n\n\n
                                        5. M&S Process\/Product Management.<\/li>\n<\/ol>\n<\/li>\n\n\n\n
                                        6. Potential areas of Risk.<\/li>\n\n\n\n
                                        7. Findings from Technical Reviews.<\/li>\n\n\n\n
                                        8. Where to find Development Artifacts.<\/li>\n<\/ol>\n\n\n\n

                                          10. Operator\/User\/Analyst Requirements\/Recommendations<\/strong><\/p>\n\n\n\n

                                            \n
                                          1. Education.<\/li>\n\n\n\n
                                          2. Experience.<\/li>\n\n\n\n
                                          3. Training.<\/li>\n<\/ol>\n\n\n\n

                                            11. Developer Qualifications<\/strong><\/p>\n\n\n\n

                                            12. Help<\/strong><\/p>\n\n\n\n

                                              \n
                                            1. Where to go for help.
                                              Include website or info location where there are FAQs, etc., that may also lead a user to a CM\/repository system (section 2d) where the files are stored.<\/li>\n\n\n\n
                                            2. Who to Contact for Help, Comment, or Suggestions.\n
                                                \n
                                              1. M&S Developer.<\/li>\n\n\n\n
                                              2. Configuration Manager.<\/li>\n<\/ol>\n<\/li>\n<\/ol>\n\n\n\n

                                                <\/p>\n","protected":false},"excerpt":{"rendered":"

                                                Bolded words or phrases are key terms or acronyms defined under References or concepts discussed in NASA-STD-7009 or NASA-HDBK-7009. While the Pre-A Phase of the M&S Life Cycle is essentially getting things started for M&S Development, the major efforts in development start in Phase A, which picks up the preliminary information gathered in Model Initiation and finalizes the […]<\/p>\n","protected":false},"author":41,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_uag_custom_page_level_css":"","_lmt_disableupdate":"no","_lmt_disable":"","advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":"","site-sidebar-layout":"no-sidebar","site-content-layout":"page-builder","ast-site-content-layout":"full-width-container","site-content-style":"unboxed","site-sidebar-style":"unboxed","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"disabled","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"class_list":["post-649","page","type-page","status-publish","hentry"],"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","pp_force_visibility":null,"pp_subpost_visibility":null,"pp_inherited_force_visibility":null,"pp_inherited_subpost_visibility":null,"pp_post_mime_type":"","uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"gform-image-choice-sm":false,"gform-image-choice-md":false,"gform-image-choice-lg":false},"uagb_author_info":{"display_name":"Teresa Parrish","author_link":"https:\/\/public.ksc.nasa.gov\/mns\/author\/tparrish\/"},"uagb_comment_info":0,"uagb_excerpt":"Bolded words or phrases are key terms or acronyms defined under References or concepts discussed in NASA-STD-7009 or NASA-HDBK-7009. While the Pre-A Phase of the M&S Life Cycle is essentially getting things started for M&S Development, the major efforts in development start in Phase A, which picks up the preliminary information gathered in Model Initiation and finalizes the…","coauthors":[],"author_meta":{"author_link":"https:\/\/public.ksc.nasa.gov\/mns\/author\/tparrish\/","display_name":"Teresa Parrish"},"relative_dates":{"created":"Posted 4 years ago","modified":"Updated 2 years ago"},"absolute_dates":{"created":"Posted on February 3, 2023","modified":"Updated on July 19, 2024"},"absolute_dates_time":{"created":"Posted on February 3, 2023 2:47 pm","modified":"Updated on July 19, 2024 2:24 pm"},"featured_img_caption":"","featured_img":false,"series_order":"","_links":{"self":[{"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/pages\/649","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/users\/41"}],"replies":[{"embeddable":true,"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/comments?post=649"}],"version-history":[{"count":13,"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/pages\/649\/revisions"}],"predecessor-version":[{"id":1005,"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/pages\/649\/revisions\/1005"}],"wp:attachment":[{"href":"https:\/\/public.ksc.nasa.gov\/mns\/wp-json\/wp\/v2\/media?parent=649"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}