ravenscroftj
/
brainsteam.co.uk
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

save WIP on rationale post

This commit is contained in:
James Ravenscroft 2021-02-21 14:08:38 +00:00
parent fbf5e10897
commit 66e526258e
3 changed files with 3 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
brainsteam/content/posts/2021-01-02-nlp-model-rationale/assets/simple_classifier.xml
View File

@ -1 +1 @@
<mxfile host="Electron" modified="2021-01-03T11:17:14.237Z" agent="5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) draw.io/14.1.5 Chrome/87.0.4280.88 Electron/11.1.1 Safari/537.36" etag="AGA9DLXnv4zJsaL713vJ" version="14.1.5" type="device"><diagram id="F5Ue9vwdzeswKv2T4yi_" name="Page-1">5VhZb+IwEP41kXYfQMHOAY8cpd2tSg8qLX1apYmTWA1x1jEQ9tevnTjkpNATrdpWxfPZHtsz3xxCgeNlck6tyL8iDgoUoDqJAicKAD0NAEX8qc42QwbQyACPYkcuKoA5/oskqEp0hR0UVxYyQgKGoypokzBENqtgFqVkU13mkqB6amR5qAHMbStoor+ww/wM7QOzwC8Q9vz85J4xyGaWVr5YviT2LYdsShA8U+CYEsKy0TIZo0AYL7dLtm+6Z3Z3MYpCdsyGzmywXKu3M7iZ9i/DeJZE5LIjtaytYCUfrAAj4PpGfk9YMMBemOLGn5W46MjmpyFayHzkic9Fvu+R5lCO8CsJZVUwyoEfsXCpjygS54Vb5uPQ48NHxNKD+JwV8o8ZtklgicVj4TKgDmf8WupP4ovZe2qtOSssBU65NLVsseLadcX741Sx+GczTMLUaPYTcrrd7rOXjgos9R/b5qRgKElNxJYBB3p8GHOV4t5wohfSPYk40OF+gaONjxmaR+JicLLhscIxskbUDVJO+NhxELf0iJJV6CDhMrHLxUEwJgGh6bnQ1cWvOIBR8oRKM0b6I3aQkJXw7Gf3hjJbctcjyp9TgiR7zhFZIka3fElSDUkZyUCT8qaIC2BIzC/FRF9ilgxFb6e5YCsfSMK+gLyghbw1T6HQGYoswCWbsyfGdtVve82CnEpeaBql9Gq95dE5RlFgMbyuZpM2S8gTbgjmN9nZHJg1o5uDrl5VEpMVtZHcV47/mioIDqpiFvUQa6hKnbN7+lH+cs3r2xA9nM3Qb9Ix7i6uHubTlmQz/bb43vBZW6iUXGbFUZboXZyIQEkpP5fbe7mcFRKg7Xzc4HmL2/dS36jbroX7/Q+ifqsp34H6KMFsURo/iJzT1aU0SWQKSoWtFFpjozV+MlYeIsOpwsrQqv7U1Zqjjg0qE9aIUff4B4cU3Fu/Hbyu1zQRGBWO5EVcTHTiNGSGfAHQoqRZ4bel0phpalTMljP3X8PeVaniJKiq47HwRf3wGxLj1N/P36G1jleucLCS5y2PbHTgSCQOzBvCoZxY8lIttreW9Fr5rmemdy7nb8ppDepqIK8HpSA0W4LQ1PfH25uymtZg8/l/UiAaxfXUBULfmxhe2NjfvU8b/7X67DdxSTMOc6nX+0wymafpNri96HZRFkq7hFhsS6UP6FJkRsqq+KFwO1U3Awfv1M1otbZI0z+3m+l/WZ7pR/LspF2zXuOZ9lqeGfoBRa/mGReLb9Sy5cX3kvDsHw==</diagram></mxfile>
<mxfile host="Electron" modified="2021-01-29T10:47:22.688Z" agent="5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) draw.io/14.1.8 Chrome/87.0.4280.88 Electron/11.1.1 Safari/537.36" etag="qz4HoTyBwUZzFsaK1xTF" version="14.1.8" type="device"><diagram id="F5Ue9vwdzeswKv2T4yi_" name="Page-1">7VhbU+IwFP41nXEfYErSFnjkIrrriO7izOLTTm3TNmNpummA4q/fpE3pFUFFZWdXHcn5kpwk53znMihwtIgvqBl618RGvgJUO1bgWAGgowGgiD/V3qRIHxop4FJsy0U5MMNPSIKqRJfYRlFpISPEZzgsgxYJAmSxEmZSStblZQ7xy6eGpotqwMwy/Tr6E9vMS9Ee6Ob4JcKul53cMfrpzMLMFsuXRJ5pk3UBgucKHFFCWDpaxCPkC+Nldkn3TXbMbi9GUcAO2dCa9hcr9fsUrie9qyCaxiG5akktK9NfygcrwPC5vqHXERb0sRskuPF7KS46tPhpiOYyH7nic57te6AZlCH8SkJZGQwz4GskXOohisR5wYZ5OHD58AGx5CA+Zwb8Y4ot4pti8Ui4DKiDKb+W+o14YvaOmivOClOBEy5NTEusuHEc8f4oUSz+WQyTIDGa9Yjsdrv97KXDHEv8xzYZKRiKExOxhc+BDh9GXKW4NxzruXRHQg60uF/gcO1hhmahuBgcr3mscIysEHX8hBMetm3ELT2kZBnYSLhM7HKw74+IT2hyLnR08SsOYJQ8osKMkfyIHSRgBTz92b6hyJbM9Yjy5xQgyZ4LRBaI0Q1fEpdDUkYy0KS8zuMCGBLzCjHRk5gpQ9Hdas7ZygeSsC8gL2ggb8VTKLAHIgtwyeLsibBV9ttOsyC7lBfqRim8Wm94dIZR5JsMr8rZpMkS8oRbgvlNtjYH3YrRu/22XlYSkSW1kNxXjP+KKgj2qmImdRGrqUqcs336Qf5yujffA3R/PkW/SMv4cXl9P5s0JBsUWGdPX2peawqWgtPMKExTvYNjESoJ6WdyeyeT01ICtOOQ36har4H9vXcif6Mxj0B+FGM2L4zvRdZp61IaxzIJJcJGCjtNmdJwv/dPJLAMrexPXa046tCw6sIKMaoef+eggjsruI1X1aomAqPEkayMi4lWlITMgC8AWhjXa/ymUBxTTbWa2XDm7mtY2zqVnwRVdTQSvqgefksinPj7+Ts0VvLSFfbW8qzpka0OHIosgXlLOJATC16sxfbGol4p4NXMdEoFvUZdDWQVoRCE3YYg7Oq74+1NWU2rsdlFwdn8rygRtQL72SVC35kaXtjcPx2nlf/fax/MJc3Yz6VO5yPJ1P2cfoObkG7mRaGwS4j5tkR6e58iU1BatvdH14n0M7B/pH5GqzRGmv6x/UzvX+GZfiDPTqtv1is8017LM0Pfo+jVPONi/q1aujz/bhKe/wE=</diagram></mxfile>

BIN
brainsteam/content/posts/2021-01-02-nlp-model-rationale/images/simple_classifier_with_generator.png
View File

Binary file not shown.
Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 15 KiB

After

Width:  |  Height:  |  Size: 16 KiB

3
brainsteam/content/posts/2021-01-02-nlp-model-rationale/index.md
View File

@ -82,8 +82,9 @@ We also add a couple of new downstream predictor components:
The authors refer to this configuration as a three player co-operative game if you count the introspective generator and the two predictors as the players.
## Implementing Solution 2
<!-- which was followed up and improved upon in 2019 by [Yu, Chang, Zhang and Jaakola](http://people.csail.mit.edu/tommi/papers/YCZJ_EMNLP2019.pdf). The idea is surprisingly simple: take an existing neural classification model, tack on a new -->
The design of the three player game solution described above makes it incredibly convenient to retrofit to an existing classifier. We're going to start by taking an ALBERT-based
<script type="text/javascript"