{{tag>github}}
====== Experiments Using GitHub During AUTH48 ======

==== Introduction ====

This page summarizes the GitHub experiments that the RPC has held for documents going through AUTH48. Please follow the links to see details of the individual experiments. 

To participate in an experiment, please see [[github_experiment_6|experiment setup]] to see if your document may qualify for consideration. 


==== IETF 117 workshop on using GitHub during AUTH48 ====

  * Held July 27, 2023, 13:00-14:00 PDT
  * [[https://notes.ietf.org/bH0XCkZ8QnS2d3a1PNaHfg?view|Meeting notes]]
  * [[https://www.rfc-editor.org/rpc/wiki/lib/exe/fetch.php?media=ietf117-rpc-github-workshop-02.pdf|Slides]]
  * [[https://play.conf.meetecho.com/Playout/?session=IETF117-RPC-20230727-2000|Session recording]]
  * [[https://zulip.ietf.org/#narrow/stream/378-rpc/topic/ietf-117|Chat history]]

==== IETF 114 workshop on using GitHub during AUTH48 ====

  * Held July 26, 2022, 8-9 AM EDT
  * [[https://notes.ietf.org/s-wo8xHGRFGkMB6VFQF5fQ|Meeting notes]]
  * [[https://www.rfc-editor.org/rpc/wiki/lib/exe/fetch.php?media=wiki:ietf114-rpc-github-workshop.pdf|Slides]] 
  * [[https://play.conf.meetecho.com/Playout/?session=IETF114-AUTH48GITHUB-20220726-1200|Session recording]]
  * [[https://zulip.ietf.org/#narrow/stream/344-auth48github|Chat history]]
  * [[114_github_workshop_followup|114 GitHub Workshop followup]]


==== Experiments since IETF 114 ====

[[github_experiment_6|Based on "Experiment 6" design]] discussed at the IETF 114 workshop

^                ^   RFC 9345   ^  RFC 9380  ^  RFC 9366  ^  RFC 9518  ^
| I-D         |  [[https://datatracker.ietf.org/doc/draft-ietf-tls-subcerts|draft-ietf-tls-subcerts]] |  [[https://datatracker.ietf.org/doc/draft-irtf-cfrg-hash-to-curve|draft-irtf-cfrg-hash-to-curve]] |  [[https://datatracker.ietf.org/doc/draft-ietf-sipcore-multiple reasons/|draft-ietf-sipcore-multiple-reasons]] |  [[https://datatracker.ietf.org/doc/draft-nottingham-avoiding-internet-centralization/|draft-nottingham-avoiding-internet-centralization ]] |  
| Pages submitted |  17 |  175 |  4 |  28 |
| I-D approved    |  2022-10-03 |   2022-10-02 |  2022-11-02 |  2023-09-14 | 
| AUTH48 start    |  2023-01-30 |   2023-05-03 |  2023-02-16 |  2023-12-06 | 
| Publication     |  2023-07-13 |   2023-08-11 |  2023-03-07 |  2023-12-18 |
| GitHub repo     |  https://github.com/rfc-editor/draft-ietf-tls-subcerts |  https://github.com/rfc-editor/draft-irtf-cfrg-hash-to-curve |  https://github.com/rfc-editor/draft-ietf-sipcore-multiple-reasons |  https://github.com/rfc-editor/draft-nottingham-avoiding-internet-centralization |
^ AUTH48 details  ^^^^^
| Time in state  |   22.3 weeks |   14.1 weeks |  2.1 weeks |  1.7 weeks |
| # questions at start  |   10 |    21 |  2 |  9 |
| Process notes  |  [[github_exp_9345]] |  [[github_exp_9380]] |  [[github_exp_9366]] |   [[github_exp_9518]] |   
^ Comparing with standard process ^^^^^
| Concurrent Avg. AUTH48 time*   |  3.6 weeks |  4.3 weeks |  2.2 weeks |   4.3 weeks |
| Avg. AUTH48 time for docs over 100 pages<nowiki>**</nowiki>  |   N/A |  5.7 weeks (n=8) |   N/A |   N/A |
| Avg. AUTH48 time for docs less than 30 pages<nowiki>***</nowiki> |  3.3 weeks (n=22) |   N/A |  2.5 weeks (n=13) |   3.3 weeks (n=25) |

<nowiki>*</nowiki> using standard AUTH48 process for the 3 months preceding publication.\\
<nowiki>**</nowiki> using standard AUTH48 process and published in months preceding this document.\\
<nowiki>***</nowiki> using standard AUTH48 process and published 2 months preceding this document.

In addition: RFC 9444 ([[https://datatracker.ietf.org/doc/draft-ietf-acme-subdomains/|draft-ietf-acme-subdomains]]), approved for publication in March 2023, did not become a GitHub experiment; see the [[github_exp_acme_subdomains|process notes]]. It was 22 pages and spent 5.7 weeks in AUTH48 in the typical AUTH48 process.


==== Experiments 2018-2022 ====

^                ^   RFC 8446   ^  RFC 8829  ^  RFC 9069  ^  RFC 9131  ^  RFC 9245  ^
| I-D         |  [[https://datatracker.ietf.org/doc/draft-ietf-tls-tls13|draft-ietf-tls-tls13-28]] |  [[https://datatracker.ietf.org/doc/draft-ietf-rtcweb-jsep|draft-ietf-rtcweb-jsep]] |  [[https://datatracker.ietf.org/doc/rfc9069/|draft-ietf-grow-bmp-local-rib]] |  [[https://datatracker.ietf.org/doc/rfc9131/|draft-ietf-6man-grand ]] |  [[https://datatracker.ietf.org/doc/draft-eggert-bcp45bis/|draft-eggert-bcp45bis]] |
| Pages submitted |  156 |  115 |  15 |  24 |  11 |
| I-D approved    |  2018-03-21 |   2018-03-01\\ (into MISSREF state) |  2021-07-12 |  2021-07-20 |  2022-02-25 |
| AUTH48 start   |  2018-06-14 |   2020-07-06 |  2021-10-18 |  2021-09-15 |  2022-04-07 | 
| Publication    |  2018-08-10 |   2021-01-20 |  2022-02-16 |  2021-10-01 |  2022-06-21 |
| GitHub repo    |  https://github.com/tlswg/tls13-rfc |  https://github.com/rtcweb-wg/jsep |  https://github.com/rfc-editor/rfc9069-AUTH48 |  https://github.com/rfc-editor/rfc9131-AUTH48|  https://github.com/rfc-editor/draft-eggert-bcp45bis |
^ AUTH48 details  ^^^^^^
| Time in state  |   8.2 weeks |   28.3 weeks |  17.3 weeks |  2.3 weeks |  10.5 weeks |
| # questions at start  |   58 |    60\\ (yielded [[https://github.com/rtcweb-wg/jsep/issues?q=is%3Aissue+is%3Aclosed+assignee%3Aajeanmahoney|78 issues]] in GitHub) |  12 |  17 |  6 |
| Process notes  |  [[github_exp_8446]] |  [[github_exp_8829]] |  [[github_exp_9069]] |   [[github_exp_9131]] |   [[github_exp_9245]] |   
^ Comparing with standard process ^^^^^^
| Concurrent Avg. AUTH48 time*   |  3.2 weeks |  10.1 weeks |  12.5 weeks |  13.3 weeks |  12.7 weeks |
| Avg. AUTH48 time for docs over 100 pages<nowiki>**</nowiki>  |  4.4 weeks (n=7) |  3.5 weeks (n=6) |  |
| Avg. AUTH48 time for docs less than 30 pages<nowiki>**</nowiki> |  |  |  13.5 weeks (n=7) |  7.1 weeks (n=6) |   3.4 weeks (n=17) |