見出し画像

AzureからGPTを使ってみる | RAG(データベース検索編)


前の記事で、独自データとして利用したいドキュメントをチャンクに分割するというところまで書きました。今回は、その分割したドキュメントをベクトル化して、データベースへ格納、類似度から検索するところまで書いてみようと思います。
Vector DBとしてChromaを、embeddingにはAzureにあるOpenAIのtext-embedding-ada-002を利用します。
テストには、前回利用した文章を使います。

# 昔々
あるところにおじいさんとおばあさんがいました。
## おじいさんとおばあさん
おじいさんは山へ芝刈りに、おばあさんは川へ洗濯に行きました。

## 桃が流れてくる
おばあさんが川で洗濯をしていると、大きな桃がどんぶらこどんぶらこと流れてきました。
## 桃太郎誕生
おじいさんとおばあさんが桃を割ると、中から元気な男の子が出てきました。
その子は桃から生まれたので「桃太郎」と名付けられました。

・MarkdownHeaderTextSplitterで分割後、embedding,vectorstoreへ格納まで

#langchain-chroma=0.1.3   
#langchain-openai=0.1.15
#langchain-text-splitters=0.2.2  

from langchain_chroma import Chroma
from langchain_openai import AzureOpenAIEmbeddings
from langchain_text_splitters import MarkdownHeaderTextSplitter

from dotenv import load_dotenv
import os

# OpenAI APIキーの設定
dotenv_path = ".env"
load_dotenv(dotenv_path)

OPENAI_API_BASE = os.getenv('OPENAI_API_BASE')
OPENAI_API_VERSION = os.getenv('OPENAI_API_VERSION')
OPENAI_API_KEY = os.getenv('OPENAI_API_KEY')

os.environ["AZURE_OPENAI_API_KEY"] = OPENAI_API_KEY
os.environ["AZURE_OPENAI_ENDPOINT"] = OPENAI_API_BASE

# Load example document
with open("momo01.md") as f:
    state_of_the_union = f.read()

# Markdown見出しで文章を分割します    
headers_to_split_on = [
    ("#", "Header 1"),
    ("##", "Header 2"),
    ("###", "Header 3"),
]    

markdown_splitter = MarkdownHeaderTextSplitter(
    headers_to_split_on=headers_to_split_on,
    strip_headers = False #コンテンツび分割されるヘッダーを含めるかどうか
    )

md_header_splits = markdown_splitter.split_text(state_of_the_union)

#embeddingには、Azureからtext-embedding-ada-002を使用します。
embed = AzureOpenAIEmbeddings(
    model = 'text-embedding-ada-002',
)
documents = md_header_splits

# VectorStoreの準備
vectorstore = Chroma.from_documents(
    documents,
    embedding=embed,
    #collection_name="example_collection",
    #persist_directory="./chroma_langchain_db",  # Where to save data locally, remove if not neccesary
)    

vectorstoreの中身を確認してみます。

num_docs = vectorstore._collection.count()
print(f"Number of documents: {num_docs}")

stored_data = vectorstore._collection.get(include=["metadatas", "documents", "embeddings"])

# Print out or inspect the data
print(stored_data["documents"])
print(stored_data["metadatas"])
print(stored_data["embeddings"])
Number of documents: 4
['# 昔々\nあるところにおじいさんとおばあさんがいました。', '## 桃太郎誕生\nおじいさんとおばあさんが桃を割ると、中から元気な男の子が出てきました。\nその子は桃から生まれたので「桃太郎」と名付けられました。', '## おじいさんとおばあさん\nおじいさんは山へ芝刈りに、おばあさんは川へ洗濯に行きました。', '## 桃が流れてくる\nおばあさんが川で洗濯をしていると、大きな桃がどんぶらこどんぶらこと流れてきました。']
[{'Header 1': '昔々'}, {'Header 1': '昔々', 'Header 2': '桃太郎誕生'}, {'Header 1': '昔々', 'Header 2': 'おじいさんとおばあさん'}, {'Header 1': '昔々', 'Header 2': '桃が流れてくる'}]
[[-0.0006519419839605689, -0.010648385621607304, 0.002528744749724865, 0.004445059224963188, -0.00234106439165771, 0.0216655470430851, 0.005824673920869827, 0.0011540690902620554, 0.003556047333404422, -0.03192540258169174, 0.005650164093822241, 0.005383460316807032, 0.002393746515735984, -0.017069026827812195, -0.018346570432186127, 0.006246131379157305, 0.013565661385655403, 0.00280038733035326, 0.030134208500385284, -0.01667391136288643, 0.01174154132604599, 0.03100346401333809, -0.02130994200706482, -0.007184532471001148, -0.019518747925758362, 0.009654009714722633, 0.02469477243721485, -0.03342684358358383, 0.017069026827812195, -0.028501059859991074, 0.008211835287511349, -0.01351297926157713, 0.009772544726729393, -0.010365218855440617, -0.027974238619208336, -0.04580715671181679, -0.023562105372548103, 0.003842506557703018, 0.002314723329618573, 0.01781974732875824, 0.01465881709009409, -0.0010594057384878397, -0.0065391757525503635, 0.00617040041834116, -0.020203616470098495, 0.013065180741250515, -0.03100346401333809, 0.014974909834563732, -0.001700646709650755, 0.021942129358649254, 0.0008153390954248607, 0.02565622329711914, -0.04941588640213013, -0.034348782151937485, -0.010668141767382622, 0.006789416074752808, -0.024655260145664215, 0.023153819143772125, -0.021362625062465668, -0.009127187542617321, -0.006315276492387056, 0.00277075357735157, -0.017990965396165848, -0.0026176460087299347, -0.0168582983314991, -0.003750312840566039, 0.0027065470349043608, -0.008119640871882439, -0.027289370074868202, -0.0010108393616974354, 0.025564027950167656, 0.025985486805438995, -0.0028761178255081177, -0.012722746469080448, 0.01980850100517273, -0.009693521074950695, -0.011030332185328007, -0.004389084409922361, -0.01673976331949234, -0.004303475841879845, 0.008844020776450634, -0.015304173342883587, 0.0421457439661026, -0.011998366564512253, -0.004494448658078909, 0.001759914099238813, -0.024945013225078583, 0.017477313056588173, -0.002709839725866914, -0.020822633057832718, 0.017319267615675926, 0.026881083846092224, -0.0027921556029468775, 0.008699145168066025, 0.02661767229437828, 0.010095222853124142, 0.008218420669436455, 0.023219671100378036, 0.0002909867325797677, -0.015580755658447742, -0.02173139899969101, 0.013776390813291073, -0.013460297137498856, 0.002207712735980749, -0.036166317760944366, -0.006703807506710291, 0.010780091397464275, -0.009989858604967594, 0.006921121384948492, -0.011320083402097225, 0.0060156467370688915, 0.03819458186626434, 0.03150394558906555, -0.02818496711552143, -0.03974870592355728, -0.0024892331566661596, 0.018201693892478943, 0.0014915642095729709, -0.026644013822078705, 0.0011145573807880282, 0.010305951349437237, 0.02541915327310562, -0.0036943380255252123, -0.010780091397464275, 0.013868584297597408, 0.010305951349437237, -0.019821669906377792, -0.0014364125672727823, 0.011497885920107365, -0.009858152829110622, 0.03637704625725746, 0.003928115125745535, 0.014645646326243877, -0.007191117852926254, -0.014158336445689201, 0.011267401278018951, -0.009555230848491192, -0.026275238022208214, -0.019887523725628853, -0.018636321648955345, 0.02264016680419445, 0.0011820564977824688, -0.014500770717859268, -0.01005571149289608, -0.004678836092352867, 0.026222554966807365, 0.015607096254825592, 0.008672804571688175, 0.01662122830748558, 0.002752644009888172, 0.023285524919629097, 0.003621899988502264, 0.008574024774134159, -0.007494040299206972, 0.009318160824477673, -0.0029353853315114975, 0.015501732006669044, 0.018465105444192886, -0.022785043343901634, 0.0007412547711282969, 0.012512017972767353, 0.02565622329711914, 0.028369354084134102, -0.00879133865237236, -0.010760335251688957, 0.027895215898752213, -0.009706691838800907, -0.011194963939487934, 0.011036916635930538, -0.010029369965195656, -0.02184993401169777, 0.0023953928612172604, -0.043146707117557526, 0.001349157770164311, -0.01817535236477852, 0.014382235705852509, -0.003017701208591461, 0.014685157686471939, -0.032478563487529755, -0.01884705014526844, -0.027842532843351364, -0.031582966446876526, 0.013829072937369347, 0.012591041624546051, 0.007046241778880358, -0.006980388890951872, -0.0010948015842586756, 0.020704098045825958, 0.0003636305336840451, -0.0007852937560528517, 0.02191578783094883, 0.044779855757951736, 0.013387859798967838, -0.018939243629574776, -0.6115347743034363, -0.02017727494239807, -0.02439185045659542, -0.0068486835807561874, 0.03721996024250984, 0.015106615610420704, -0.00791549775749445, 0.02258748561143875, -0.03353220969438553, 0.013242983259260654, -0.017306096851825714, 0.026881083846092224, 0.00908767618238926, 0.012689820490777493, -0.012867623008787632, -0.008356710895895958, 0.002138567389920354, -0.012130072340369225, 0.010661556385457516, -0.014092483557760715, -0.010035955347120762, 0.013960777781903744, -0.008481831289827824, -0.009021823294460773, -0.0027295956388115883, -0.00942352507263422, 0.011781052686274052, -0.027895215898752213, -0.0027839241083711386, 0.04672909528017044, -0.04601788520812988, 0.017595848068594933, 0.022073833271861076, 0.009812056086957455, 0.04575447365641594, -0.012248607352375984, -0.007507211063057184, 0.046281296759843826, 0.006074914243072271, 0.028395695611834526, -0.007526966743171215, -0.0183729100972414, -0.0032284299377352, 0.010701067745685577, 0.00866621918976307, -0.0057291872799396515, 0.021217748522758484, -0.020546050742268562, 0.01065497100353241, 0.007546722423285246, -0.005505288019776344, 0.0009392244974151254, -0.007757451385259628, 0.004464814905077219, -0.008626706898212433, 0.004952125251293182, -0.0002895462093874812, -0.027315711602568626, -0.000390177418012172, 0.009535474702715874, 0.007823304273188114, 0.017187561839818954, -0.002635755343362689, 0.0045635937713086605, -0.010845944285392761, 0.021388966590166092, -0.03448048606514931, 0.02624889649450779, 0.021244090050458908, -0.022007981315255165, 0.0033519037533551455, 0.025261105969548225, -0.0026588039472699165, 0.009252307936549187, 0.014553452841937542, 0.006934292148798704, 0.03239954262971878, 0.009225967340171337, -0.010404731146991253, -0.0030423959251493216, 0.009785715490579605, -0.0021797253284603357, -0.031767357140779495, 0.002904105233028531, 0.011702029965817928, -0.014974909834563732, -0.04449010267853737, 0.021230919286608696, 0.01505393348634243, -0.02240309864282608, -0.0021813716739416122, 0.010049126110970974, 0.006661003455519676, -0.017661701887845993, 0.0015179053880274296, 0.01914997212588787, -0.03239954262971878, -0.0013656208757311106, 0.014039801433682442, -0.004412132780998945, -0.014685157686471939, -0.0008626707131043077, 0.014592964202165604, -0.0020150933414697647, -0.0027542903553694487, 0.0018800953403115273, -0.002168201142922044, -0.005152975674718618, 0.03590290620923042, -0.01860998012125492, 0.03956431895494461, -0.020914826542139053, -0.012419824488461018, 0.005986012984067202, -0.0010026077507063746, -0.030081525444984436, 0.016331477090716362, 0.01926850713789463, 0.026630843058228493, 0.01174154132604599, 0.01584416627883911, 0.012920305132865906, 0.010194001719355583, -0.0012643723748624325, 0.033505868166685104, 0.03203076496720314, 0.002067775698378682, -0.009054750204086304, 0.0326366126537323, -0.008462075144052505, -0.004981759004294872, -0.0016545497346669436, 0.02456306666135788, -0.020730437710881233, 0.016766104847192764, -0.008297443389892578, 0.012189339846372604, -0.01751682534813881, 0.03658777475357056, -0.011010576039552689, -0.010852529667317867, 0.0068618543446063995, 0.01564660854637623, 0.0006144882645457983, -0.004398962017148733, -0.0068552689626812935, -0.018886562436819077, -0.008541098795831203, -0.013137619011104107, 0.012953231111168861, 0.0129137197509408, -0.005887233652174473, -0.020927997305989265, 0.011649347841739655, -0.020322151482105255, 0.002472769934684038, -0.005070659797638655, -0.01345371175557375, -0.020743608474731445, 0.013815902173519135, -0.0036679969634860754, 0.018978755921125412, -0.027473757043480873, 0.0012948293006047606, 0.01039156038314104, -0.00654576113447547, 0.013242983259260654, 0.0005041849217377603, -0.002293321304023266, -0.024128438904881477, -0.02046702802181244, -0.021876275539398193, 0.002293321304023266, -0.006875024642795324, 0.005317607894539833, -0.006835513282567263, 0.002332832897081971, 0.014013459905982018, 0.0059794276021420956, -0.02011142298579216, -0.008271102793514729, -0.014751010574400425, 0.004520789720118046, -0.010556192137300968, 0.03548144921660423, -0.009739618748426437, 0.020980678498744965, 0.00939718447625637, 0.013019083999097347, 0.017727553844451904, -0.01660805754363537, 0.018741685897111893, 0.01056936290115118, 0.011537398211658001, 0.02823765017092228, -0.00045191432582214475, 0.016173429787158966, 0.02776351012289524, -0.015383196994662285, 0.023509424179792404, 0.014764181338250637, -0.000988614046946168, 0.008415978401899338, -0.012202510610222816, 0.02805326133966446, -0.029133247211575508, 0.008244761265814304, -0.01830705814063549, 0.021705059334635735, 0.005097000859677792, -0.012353971600532532, -0.017661701887845993, -0.004636032041162252, -0.016120746731758118, 0.020190445706248283, 0.010240099392831326, -0.0038490919396281242, 0.007447943557053804, 0.0008025800925679505, -0.00639759236946702, -0.005607359576970339, 0.006763075012713671, -0.0018554006237536669, -0.023575276136398315, -0.018873391672968864, -0.021244090050458908, 0.012874208390712738, 0.013216642662882805, 0.007085753604769707, -0.016845127567648888, -0.01643684133887291, 0.00557114090770483, -0.006223082542419434, 0.034901946783065796, -0.004820419475436211, -0.016634399071335793, 0.02408892661333084, -0.020677756518125534, 0.02270602062344551, -0.016226112842559814, -0.0034177566412836313, 0.020848972722887993, 0.03131955862045288, 0.006973803974688053, 0.0007754158577881753, 0.011076428927481174, 0.044279374182224274, -0.004616276361048222, -0.0054427278228104115, 0.008178908377885818, -0.011458374559879303, -0.00211387244053185, 0.003753605531528592, 0.022561144083738327, -0.003490194445475936, -0.006364665925502777, 0.011669103056192398, 0.003356842789798975, 0.01878119818866253, 0.03160930797457695, 0.016212942078709602, 0.010720823891460896, -0.018149010837078094, 0.0012726039858534932, 0.024523556232452393, -0.013947607949376106, 0.0158309955149889, -0.018886562436819077, -0.017556337639689445, -0.004873101599514484, -0.02530061826109886, -0.009746203199028969, -0.011069843545556068, -0.017898771911859512, 0.022205539047718048, -0.010279610753059387, -0.0057324799709022045, 0.018623150885105133, 0.03463853523135185, 0.013921266421675682, -0.031635649502277374, -0.04791444540023804, 0.02469477243721485, -0.009351086802780628, -0.009252307936549187, -0.02005873993039131, -0.017069026827812195, -0.02076995000243187, -0.016278794035315514, 0.009640838950872421, 0.004616276361048222, 0.011353010311722755, 0.00560077466070652, 0.006947462912648916, -0.0016183307161554694, 0.011412277817726135, 0.04269890859723091, -0.02378600463271141, -0.025037206709384918, -0.013539320789277554, -0.0011746480595320463, -0.0183729100972414, -0.027737168595194817, 0.007461113855242729, 0.025142570957541466, -0.005347241647541523, 0.0006799293914809823, 0.0022982601076364517, -0.01045082788914442, -0.008402807638049126, -0.009930591098964214, -0.008165738545358181, -0.0241547804325819, 0.023680640384554863, 0.010707653127610683, -0.003845799248665571, -0.007401846349239349, 0.005189194809645414, 0.022179197520017624, -0.013829072937369347, -0.001988752279430628, -0.030134208500385284, -0.04038089141249657, 0.010187417268753052, 0.036403387784957886, 0.006377836689352989, -0.0046063982881605625, 0.00041199111728928983, 0.021955298259854317, 0.0030423959251493216, -0.03463853523135185, -0.023759663105010986, 0.0012898902641609311, 0.0016422023763880134, 0.011478130705654621, 0.007770621683448553, 0.035244379192590714, -0.01914997212588787, 0.002072714501991868, -0.0010717530967667699, -0.024286486208438873, -0.019821669906377792, 0.032662954181432724, 0.002403624588623643, -0.02028263919055462, 0.022890407592058182, 0.023930881172418594, 0.018807539716362953, -0.013447127304971218, -0.020388003438711166, 0.0018241205252707005, 0.04491155967116356, 0.018741685897111893, -0.007783792447298765, 0.005567848216742277, -0.006002475973218679, -0.024997694417834282, 0.007368920370936394, -0.013322006911039352, -0.0005782692460343242, 0.0013647978194057941, 0.06195424497127533, 0.013684196397662163, -0.019479237496852875, 0.029396656900644302, 0.027078641578555107, 0.02486599050462246, -0.02552451752126217, 0.003157638246193528, -0.014500770717859268, -0.013842242769896984, 0.010108393616974354, -0.01388175506144762, -0.011958855204284191, 0.031029805541038513, 0.0019821671303361654, 0.0007116210181266069, -0.033874642103910446, 0.02100702002644539, 0.024194292724132538, -0.015435879118740559, 0.0028152039740234613, 0.005995890591293573, 0.017319267615675926, 0.007955009117722511, -0.032373201102018356, 0.0010289488127455115, -0.016713421791791916, -0.00630869111046195, -0.0734916403889656, -0.025037206709384918, -0.023706981912255287, -0.009535474702715874, -0.018438763916492462, -0.025906462222337723, -5.401981616159901e-05, -0.041276488453149796, -0.022429438307881355, 0.01059570349752903, 0.027500098571181297, 0.024431360885500908, -0.03895847499370575, -0.011998366564512253, 0.02589329145848751, -0.018504615873098373, -0.008422563783824444, 0.008692559786140919, -0.03777312487363815, -0.0025830732192844152, 0.029370315372943878, 0.010101808235049248, -0.02871178835630417, -0.015040762722492218, 0.0013030607951804996, 0.018162181600928307, -0.00719770323485136, 0.006262594368308783, 0.020756779238581657, -0.008389637805521488, -0.003944578114897013, 0.009469621814787388, 0.022495292127132416, -0.028580082580447197, -0.011043502017855644, 0.01776706613600254, -0.01400029007345438, -0.01594953052699566, -0.02215285785496235, 0.000765537959523499, -0.0017105245497077703, 0.004833590239286423, -0.0022982601076364517, -0.002591304713860154, 0.0065721021965146065, 0.020690927281975746, -0.006127596367150545, 0.010128149762749672, -0.012485677376389503, 0.004942247178405523, 0.017925111576914787, -0.000354369985871017, 0.028158625587821007, 0.013565661385655403, -0.03463853523135185, -0.0077047692611813545, -0.0017697920557111502, 0.024181121960282326, 0.018978755921125412, -0.023311864584684372, 0.0020924704149365425, -0.003911652136594057, -0.028580082580447197, -0.007467699237167835, 0.00873207114636898, -0.004678836092352867, 0.024655260145664215, 0.0026110606268048286, -0.009502548724412918, -0.04288329556584358, 0.021467989310622215, -0.010885455645620823, 0.01134642492979765, -0.007764036301523447, -0.024299656972289085, -0.005478946957737207, -0.008415978401899338, 0.004929076414555311, -0.015383196994662285, -0.00477103004232049, -0.023469911888241768, -0.019768988713622093, -0.0068157571367919445, 0.0028398989234119654, 0.010543021373450756, 0.006644540000706911, -0.0013573893811553717, -0.007447943557053804, 0.009495963342487812, 0.02017727494239807, -0.029528362676501274, -0.011293742805719376, 0.016041724011301994, 0.007685013115406036, -0.01650269329547882, 0.028632765635848045, 0.01921582594513893, -0.009153529070317745, -9.836751269176602e-05, 0.005867477972060442, 0.011320083402097225, -0.025182083249092102, 0.018320228904485703, -0.019663624465465546, 0.00848841667175293, 0.019360702484846115, 0.02902788296341896, 0.004408840090036392, -0.005478946957737207, -0.0027032543439418077, 0.003205381566658616, -0.00665441807359457, -0.004402254708111286, 0.010042540729045868, -0.051865607500076294, 0.015738802030682564, -0.011688859201967716, -0.0017697920557111502, 0.00480066379532218, 0.013480053283274174, 0.002639048034325242, -0.0014849789440631866, 0.007263555657118559, 0.012097146362066269, -0.013973948545753956, 0.04459546506404877, -0.019281677901744843, 0.01442174706608057, -0.022916749119758606, -0.0003422283916734159, -0.017200732603669167, 0.011794223450124264, 0.002671974478289485, -3.3569456718396395e-05, 0.010101808235049248, 0.02522159367799759, 0.003753605531528592, 0.018017306923866272, -0.02306162565946579, 0.007204288151115179, 0.01053643599152565, -0.041645266115665436, -0.020611902698874474, 0.0032119667157530785, -0.01606806553900242, -0.014606134966015816, -0.029765432700514793, -0.041329171508550644, -0.004053235519677401, 0.007553307805210352, 0.01997971720993519, -0.0018438763218000531, 0.015514902770519257, -0.021244090050458908, -0.044885218143463135, -0.013499809429049492, -0.00411250302568078, 0.031530287116765976, -0.008929629810154438, 0.01535685546696186, 0.01376322004944086, 0.001587873906828463, -0.017253413796424866, -0.04119746759533882, 0.01872851513326168, 0.0019640575628727674, 0.01648952253162861, 0.04285695403814316, -0.018754856660962105, -0.012070804834365845, 0.022297732532024384, 0.016305135563015938, -0.012808355502784252, -0.036456070840358734, 0.0237728338688612, 0.016094407066702843, -0.02275870181620121, -0.002683498663827777, 0.017740724608302116, 0.005093708634376526, 0.02530061826109886, -0.00064329884480685, -0.017964623868465424, -0.008060373365879059, 0.0001617507659830153, -0.014856374822556973, -0.004349572584033012, -0.004754567053169012, 0.01039156038314104, 0.02902788296341896, -0.026038167998194695, 0.026235725730657578, -0.022231880575418472, 0.026327921077609062, 0.02823765017092228, -0.017609018832445145, 0.03318977355957031, -0.010062296874821186, 0.008356710895895958, -0.008198664523661137, 0.020203616470098495, -0.023865027353167534, -0.042777933180332184, -0.03508633375167847, 0.04504326358437538, 0.014237359166145325, -0.007935253903269768, -0.009522303938865662, 0.028211308643221855, 0.029581045731902122, 0.013750049285590649, -0.004333109594881535, -0.022126516327261925, -0.015804653987288475, -0.019821669906377792, 0.026630843058228493, -0.00511675700545311, -0.0026489258743822575, 0.0008264516945928335, -0.017134878784418106, -0.005307729821652174, -0.02781619131565094, -0.021283600479364395, 0.007368920370936394, -0.03400634974241257, -0.026946935802698135, -0.008290858007967472, 0.0024052709341049194, 0.010299366898834705, -0.014158336445689201, -0.0029320926405489445, -0.018754856660962105, 0.011010576039552689, -0.03100346401333809, 0.02968640998005867, -0.03666679933667183, -0.014197847805917263, 0.0004035537422169, -0.018873391672968864, -0.00377006852068007, -0.006058450788259506, 0.021270431578159332, 0.004313353449106216, -0.015541243366897106, -0.023562105372548103, 0.016660740599036217, 0.013203471899032593, -0.016331477090716362, 0.020559221506118774, -0.016581716015934944, 0.007941839285194874, -0.006522712763398886, -0.03403268754482269, -0.03853701427578926, 0.009884494356811047, -0.000789409561548382, 0.021388966590166092, 0.0029238611459732056, -0.039169203490018845, 0.022771872580051422, -0.007573063485324383, -0.016634399071335793, 0.00425737863406539, -0.030740052461624146, 0.008797924034297466, -0.016357816755771637, 0.019834840670228004, -0.03463853523135185, -0.01987435296177864, -0.01781974732875824, -0.018517786636948586, -0.0048500532284379005, 0.010984234511852264, 0.00294197048060596, 0.006842098198831081, -0.006420640740543604, 0.028580082580447197, -0.0012265070108696818, -0.0040433574467897415, 0.013315421529114246, -0.0129137197509408, 0.024246973916888237, -0.01402663066983223, -0.026775719597935677, -0.021217748522758484, -0.006614906247705221, 0.021270431578159332, -0.005867477972060442, -0.014961740002036095, -0.012841281481087208, -0.013552491553127766, -0.019768988713622093, 0.019163142889738083, 7.418721361318603e-05, 0.027895215898752213, 0.01564660854637623, -0.01619977131485939, 0.018043646588921547, 0.011484715156257153, -0.006680759135633707, 0.02865910716354847, -0.008172322995960712, 0.006621491629630327, -0.024484043940901756, -0.013868584297597408, 0.018333399668335915, 0.013565661385655403, -0.01763536036014557, -0.02119140699505806, -0.005501995328813791, -0.010733994655311108, 0.026999618858098984, 0.013183715753257275, -0.004382499027997255, -0.01071423850953579, -0.015277832746505737, -0.008811094798147678, -0.014158336445689201, -0.00648649362847209, 0.012782013975083828, -0.038695063441991806, 0.006387714296579361, 0.004708469845354557, -0.004099332261830568, -0.022771872580051422, 0.004303475841879845, 0.0062856427393853664, -0.004510911647230387, 0.025392811745405197, -0.005636993329972029, -0.008284272626042366, 0.004537252709269524, -0.01860998012125492, 0.01297298725694418, 0.011636177077889442, -0.01813584193587303, 0.02130994200706482, 0.01775389537215233, 0.0013829072704538703, -0.003588973544538021, -0.003931407816708088, -0.013150789774954319, 0.001652903389185667, 0.008330370299518108, -0.0060485731810331345, -0.0028876420110464096, -0.02535329945385456, 0.007533552125096321, -0.03147760406136513, -0.001420772634446621, 0.00602223165333271, -0.02275870181620121, 0.0017204025061801076, 0.018649492412805557, 0.015989042818546295, -0.03806287795305252, 0.007461113855242729, -0.011748126707971096, -0.018517786636948586, 0.0005741534405387938, -0.036034613847732544, 0.018754856660962105, -0.026525478810071945, 0.014369064942002296, 0.014382235705852509, 0.012031293474137783, -0.02794789709150791, 0.0011540690902620554, -0.02456306666135788, -0.03951163589954376, -0.0062889354303479195, 0.27184006571769714, -0.025853781029582024, -0.016147088259458542, 0.01376322004944086, -0.015607096254825592, 0.0025649636518210173, 0.016054894775152206, 0.020256299525499344, -0.00651612738147378, 0.02842203713953495, -0.042777933180332184, 0.006305398419499397, -0.005149683449417353, 0.0031741014681756496, 0.03234685957431793, -0.01505393348634243, -0.002120457822456956, -0.008837436325848103, -0.048862721771001816, -0.010898626409471035, -0.014079312793910503, 0.00020115950610488653, -0.005771991331130266, -0.008574024774134159, 0.019255338236689568, -0.011813979595899582, -0.0006996852462179959, -0.004418718162924051, 0.009291820228099823, 0.0013540966901928186, 0.002963372739031911, -0.005709431599825621, 0.004408840090036392, -0.0073425788432359695, 0.0017022929387167096, -0.00890987366437912, 0.01933436095714569, 0.0003860616125166416, 0.016568545252084732, 0.016397329047322273, 0.008501587435603142, 0.01279518473893404, 0.011781052686274052, 0.010305951349437237, -0.010701067745685577, 0.026578160002827644, -0.010161075741052628, -0.018149010837078094, -0.007994521409273148, 0.010786676779389381, -0.017055856063961983, 0.0032300762832164764, 0.03076639398932457, 0.025195254012942314, 0.011530812829732895, 0.0021599694155156612, 0.026341089978814125, -0.007619160693138838, -0.03316343203186989, -0.005034441128373146, 0.01835974119603634, 0.02065141499042511, -0.02570890448987484, 0.0034276344813406467, -0.01806998811662197, 0.007994521409273148, -0.008620121516287327, -0.029528362676501274, -0.003467146074399352, -0.03629802167415619, 0.02649913728237152, -0.0025814268738031387, -0.008778168819844723, -0.011412277817726135, -0.010819602757692337, -0.010766920633614063, 0.04912613332271576, 0.008350125513970852, 0.011135696433484554, -0.0017911941977217793, -0.0028300208505243063, 0.013829072937369347, -0.00032926362473517656, 0.013934437185525894, -0.007243799977004528, -0.025550857186317444, 0.003615314606577158, -0.004161892458796501, -0.02721034735441208, -0.017727553844451904, 0.0168582983314991, -0.02311430685222149, 0.010635215789079666, -0.0015565938083454967, -0.00719770323485136, 0.007605989929288626, -0.013447127304971218, 0.015883678570389748, -0.006555638741701841, 0.0009458097629249096, -0.005017977673560381, -0.03184637799859047, 0.034954626113176346, 0.002808618824928999, -0.005755528341978788, -0.00132857880089432, 0.008534513413906097, 0.008541098795831203, 0.0016133917961269617, -0.005120049696415663, -0.018438763916492462, -0.03521803766489029, -0.002540268935263157, -0.004017016384750605, -0.007487454917281866, -0.016028553247451782, -0.048019807785749435, -0.024602578952908516, 0.009594742208719254, -0.007039656396955252, 0.01411882508546114, -0.0071713621728122234, -0.02373332343995571, 0.010180831886827946, -0.002688437467440963, -0.005363704636693001, -0.003809580346569419, -0.006101255305111408, 0.0046063982881605625, -0.03582388162612915, 0.04683445766568184, -0.014408576302230358, 0.026591330766677856, 0.02655182033777237, -0.0022801507730036974, 0.008244761265814304, 0.027552781626582146, 0.0007667727186344564, -0.008639877662062645, 0.004428595770150423, 0.02186310477554798, 0.009476207196712494, 0.023983562365174294, -0.018280716612935066, -0.001051174127496779, -0.017727553844451904, 0.011484715156257153, -0.0008923044661059976, 0.022126516327261925, 0.001610922277905047, -0.03774678334593773, -0.014184677042067051, 0.007243799977004528, 0.003997260704636574, 0.02606450952589512, -0.026933765038847923, -0.016581716015934944, -0.012452750466763973, 0.007948423735797405, 0.015514902770519257, -0.030845416709780693, -0.030819077044725418, 0.04604422673583031, -0.018504615873098373, -0.029712749645113945, -0.021415306255221367, -0.16710788011550903, 0.01559392549097538, 0.0035132430493831635, -0.015699289739131927, 0.021533841267228127, -0.02142847701907158, 0.013618343509733677, -0.03129321709275246, -0.017609018832445145, 0.016278794035315514, 0.02154701203107834, -0.002028264105319977, -0.017977794632315636, -0.00029139831895008683, 0.011194963939487934, 0.010845944285392761, -0.017661701887845993, 0.02522159367799759, 0.06421957910060883, 0.01584416627883911, 0.04709786921739578, 0.01191934384405613, 0.007461113855242729, -0.0071055092848837376, 0.020440686494112015, 0.03321611508727074, -0.0025089888367801905, 0.007296482101082802, -0.01011497899889946, -0.0010906858369708061, -0.023443570360541344, 0.0068223425187170506, 0.04533301666378975, 0.012630552984774113, 0.0011310206027701497, -0.010299366898834705, -0.018873391672968864, -0.00785623025149107, -0.007224044296890497, -0.017003174871206284, 0.009285234846174717, 0.021151896566152573, -0.008336955681443214, -0.0060452804900705814, -0.014882716350257397, 0.032478563487529755, 0.018873391672968864, -0.01584416627883911, -0.012479091994464397, -0.003743727458640933, -0.01128715742379427, -0.02987079694867134, 0.015396367758512497, -0.010240099392831326, 0.012083975598216057, -0.003327209036797285, -0.007401846349239349, 0.009654009714722633, -0.013052010908722878, 0.004398962017148733, 0.0005045965081080794, -0.03321611508727074, 0.02348308265209198, 0.02884349413216114, -0.0006507072830572724, 0.02011142298579216, -0.019940204918384552, 0.008495002053678036, -0.003743727458640933, -0.0048895650543272495, -0.017424631863832474, -0.015146126970648766, 0.01830705814063549, -0.026512308046221733, 0.01631830632686615, -0.016897810623049736, -0.014224189333617687, 0.011181793175637722, 0.02661767229437828, 0.005956379231065512, -0.02678888849914074, 0.03342684358358383, -0.010213757865130901, 0.002168201142922044, -0.009989858604967594, 0.029844455420970917, 0.0006601735949516296, -0.017859259620308876, -0.03972236439585686, -0.026393773034214973, 0.03232051804661751, -0.028369354084134102, -0.00242996565066278, -0.017911940813064575, -0.011175207793712616, 0.019597770646214485, -0.020638244226574898, -0.0005980251007713377, -0.0015121432952582836, 0.004115795250982046, -0.019308019429445267, -0.03039761818945408, 0.0013861998450011015, 0.005422972142696381, 0.018583640456199646, 0.0012915366096422076, 0.0045965202152729034, 0.010075467638671398, 0.03353220969438553, -0.01402663066983223, 0.01727975532412529, 0.0015417769318446517, 0.011241060681641102, 0.021388966590166092, -0.00912060309201479, 0.014988080598413944, -0.010924967005848885, -0.012334215454757214, 0.019360702484846115, -0.020993849262595177, -0.011030332185328007, 0.011464959941804409, 0.024194292724132538, 0.01402663066983223, -0.01637098751962185, -0.009384013712406158, -0.046149592846632004, 0.029422998428344727, -0.012637138366699219, 0.013144204393029213, -0.0023492961190640926, 0.01601538248360157, 0.0012075743870809674, 0.033690255135297775, -0.01752999611198902, 0.010213757865130901, -0.015238321386277676, -0.02842203713953495, -0.00759940454736352, -0.009173285216093063, 0.0009433403029106557, 0.007454528473317623, 0.015580755658447742, -0.015225150622427464, -0.010786676779389381, 0.025366470217704773, -0.020019229501485825, -0.014671987853944302, 0.013671026565134525, -0.03455951064825058, -0.00981864146888256, -0.0221001747995615, -0.030265912413597107, 0.026815230026841164, 0.020690927281975746, 0.015514902770519257, 0.013921266421675682, -0.019597770646214485, -0.0004321585292927921, -0.01813584193587303, 0.009469621814787388, -0.00848841667175293, -0.027684485539793968, 0.01282811164855957, -0.002853069454431534, -0.02149433083832264, 0.0028794105164706707, -0.008929629810154438, -0.010720823891460896, -0.0029699578881263733, 0.00908767618238926, 0.016660740599036217, 6.219995702849701e-05, 0.028975199908018112, 0.0016990003641694784, -0.015409538522362709, -0.009654009714722633, -0.00211387244053185, -0.001205928041599691, -0.021705059334635735, 0.05131244659423828, 0.029844455420970917, 0.021112384274601936, 0.0183729100972414, -0.021402135491371155, -0.008949385955929756, -0.01465881709009409, -0.009759373962879181, 0.006651125382632017, 0.009548645466566086, 0.01645001210272312, -0.01265030913054943, -0.008119640871882439, -0.014698328450322151, 0.004945539869368076, -0.014698328450322151, -0.020124593749642372, 0.029949819669127464, -0.0189129039645195, 0.022890407592058182, -0.005613944958895445, -0.005719309207051992, -0.016660740599036217, -0.020927997305989265, 0.031056145206093788, -0.02902788296341896, -0.006828927900642157, -0.019584601745009422, -0.00759940454736352, -0.004497741349041462, -0.004240915644913912, -0.0027658145409077406, 0.010147904977202415, 0.010068882256746292, 0.004122380632907152, -0.020848972722887993, -0.006134181749075651, -0.0048829796724021435, 0.000774181098677218, -0.03203076496720314, 0.00439566932618618, 0.01110935490578413, 0.0006766367587260902, -0.017187561839818954, -0.00042927745380438864, 0.005004807375371456, -0.00528468145057559, -0.013960777781903744, -0.0716477632522583, 0.020388003438711166, 0.00043709747842513025, 0.025866951793432236, 0.006555638741701841, 0.009054750204086304, 0.04125014692544937, -0.007533552125096321, -0.015975872054696083, 0.009232552722096443, -0.034164395183324814, 0.025972316041588783, 0.010826188139617443, -0.022600656375288963, -0.04641300067305565, -0.0038820181507617235, 0.008462075144052505, 0.020941168069839478, 0.017911940813064575, 0.028869835659861565, 0.03203076496720314, 0.039458952844142914, 0.01351297926157713, 0.010299366898834705, -0.01077350601553917, 0.025748416781425476, -0.0158309955149889, 0.011906173080205917, -0.016173429787158966, -0.0006630546413362026, -0.000905474997125566, -0.044700831174850464, 0.02208700403571129, 0.03226783499121666, 0.01739829033613205, -0.009140358306467533, 0.02233724482357502, 0.013177130371332169, 0.021691888570785522, 0.05447337403893471, -0.03606095165014267, -0.014592964202165604, 0.014988080598413944, 0.010681312531232834, -0.016160259023308754, 0.01871534436941147, -0.019492406398057938, 0.0220474936068058, 0.032241493463516235, -0.02968640998005867, 0.015264661982655525, 0.017872430384159088, 0.010549606755375862, -0.00020815635798498988, -0.008751827292144299, -0.021481160074472427, 0.023087965324521065, 0.01668708026409149, 0.011833734810352325, -0.015883678570389748, 0.022508462890982628, 0.006749904714524746, 0.012670064345002174, 0.0021780789829790592, 0.0004243385046720505, -0.028395695611834526, -0.012775428593158722, -0.012123486958444118, -0.0017138172406703234, -0.027236687019467354, -0.0001565031270729378, 0.0033782448153942823, -0.010918382555246353, 0.02660450153052807, 0.0060123540461063385, -4.9055135605158284e-05, 0.0009507487411610782, -0.020137764513492584, -0.018623150885105133, 0.032004427164793015, 0.017911940813064575, -0.003993968013674021, -0.016120746731758118, 0.014316382817924023, 0.02818496711552143, 0.005719309207051992, -0.011998366564512253, -0.0022916749585419893, -0.011300328187644482, 0.008817680180072784, 0.0014726315857842565, 0.00377006852068007, 0.000905474997125566, 0.020019229501485825, 0.012479091994464397, 0.034533169120550156, -0.011748126707971096, -0.011102769523859024, 0.025919632986187935, 0.0011697090230882168, -0.003644948359578848, 0.009831812232732773, -0.013098107650876045, 0.01005571149289608, -0.009416939690709114, -0.010299366898834705, -0.018517786636948586, -0.021230919286608696, 0.017859259620308876, 0.02361478842794895, -0.004422010388225317, 0.009588156826794147, -0.013684196397662163, 0.024339167401194572, -0.03137223795056343, 0.004306768532842398, -0.012288118712604046, -0.03990675136446953, -0.018807539716362953, 0.040433574467897415, 0.03150394558906555, 0.017622189596295357, 0.01727975532412529, -0.009107432328164577, 0.03927456587553024, -0.023153819143772125, -0.0030605054926127195, -0.029396656900644302, 0.00015238732157740742, 0.0010791615350171924, 0.015883678570389748, -0.006394299678504467, -0.00041302008321508765, -0.003921529743820429, -0.013631514273583889, 0.017727553844451904, 0.011662517674267292, 0.02245577983558178, -0.019518747925758362, 0.030924441292881966, -0.0049257841892540455, -0.007401846349239349, 0.012953231111168861, 0.007632330991327763, 0.01388175506144762, 0.008053788915276527, -0.00280038733035326, -0.003717386396601796, 0.003977504558861256, -0.0019311312353238463, -0.03052932396531105, 0.02119140699505806, -0.014263700693845749, -0.030661029741168022, -0.012064219452440739, -0.013684196397662163, 0.020664585754275322, -0.0008881886606104672, -0.004659080412238836, 0.026867913082242012, 0.00038873686571605504, 0.027289370074868202, 0.007862815633416176, -0.025998655706644058, -0.010424486361443996, 0.010095222853124142, -0.024642091244459152, 0.005702846217900515, -0.018649492412805557, 0.020203616470098495, -0.004066405817866325, -0.012004951946437359, -0.015264661982655525, 0.017174391075968742, -0.016344645991921425, -0.01477735210210085, 0.011247646063566208, 0.026815230026841164, 0.004069698508828878, -0.019228996708989143, -0.0018603395437821746, -0.02997616119682789, -0.0020200323779135942, 0.04122380539774895, -0.017503654584288597, -0.006130889058113098, 0.006954047828912735, -0.013275910168886185], [-0.001101627596653998, -0.019165031611919403, -0.0045281825587153435, -0.021361710503697395, 0.017231428995728493, 0.013357645832002163, -0.006899148225784302, -0.002796818735077977, -0.012522381730377674, -0.03996112942695618, -0.009621976874768734, 0.015100519172847271, -0.03854052349925041, -0.017678657546639442, -0.013627298176288605, -0.007418721914291382, 0.019756950438022614, -0.005922481417655945, 0.025676144286990166, -0.028227973729372025, 0.01892826519906521, -0.006169114727526903, -0.017954885959625244, -0.004166454076766968, -0.013811450451612473, 0.027149366214871407, 0.031937334686517715, -0.020006872713565826, 0.02709675021469593, -0.0017527388408780098, 0.00892482791095972, 0.0033542094752192497, 0.0026652810629457235, -0.020651407539844513, -0.012022539041936398, -0.02650483138859272, -0.005350293125957251, -0.010108666494488716, 0.004791257902979851, 0.0010120176011696458, 0.0187835730612278, -0.0079646036028862, 0.002883962355554104, 0.005567329935729504, -0.02216408960521221, 0.0107860853895545, -0.03438393399119377, 0.005001718178391457, -0.009260248392820358, 0.012384267523884773, 0.005439080763608217, 0.015021597035229206, -0.018270576372742653, -0.0002073772920994088, -0.01669212430715561, 0.0175471194088459, -0.02533414587378502, 0.0004739465075545013, -0.019165031611919403, 0.0005516359233297408, 0.021519554778933525, -0.00010759366705315188, -0.015837129205465317, 0.0022081879433244467, -0.021782631054520607, 0.01273284200578928, -0.0024844168219715357, 0.008306601084768772, -0.03362101688981056, 0.013587837107479572, 0.008319755084812641, 0.033147480338811874, 0.02500530332326889, -0.01353522203862667, 0.012778880074620247, -0.006376286502927542, -0.04524894431233406, -0.019533338025212288, -0.02026994898915291, 0.009470708668231964, 0.01699466072022915, -0.0066919769160449505, 0.01848103664815426, 0.01288411021232605, -0.013383953832089901, -0.015074212104082108, -0.03748822212219238, 0.024518612772226334, -0.028990892693400383, -0.010259934701025486, 0.013732528313994408, 0.0017790463753044605, 0.008839328773319721, 0.013456298969686031, 0.0030105675105005503, 0.00959566980600357, -0.021532708778977394, 0.025807682424783707, -0.0025304551236331463, -0.0336473248898983, -0.023269005119800568, 0.001246319035999477, -0.0015176153974607587, -0.006225018296390772, 0.00011283461935818195, -0.007694951258599758, 0.025136839598417282, -0.017231428995728493, 0.006369709502905607, -0.018691496923565865, -0.018415266647934914, 0.015574054792523384, -0.004442683421075344, -0.024347614496946335, -0.02904350683093071, 0.015153134241700172, 0.02856997214257717, 0.011838385835289955, -0.004143435042351484, 0.022663932293653488, 0.012048846110701561, 0.01952018402516842, 0.0005072419880889356, -0.00424537668004632, 0.010549317114055157, 0.009812707081437111, -0.027596592903137207, -0.007010955363512039, -0.007129339501261711, -0.041039738804101944, 0.03348948061466217, -0.01577136106789112, 0.00424208864569664, -0.00048175654956139624, -0.006899148225784302, 0.0282805897295475, -0.018375806510448456, 0.007951449602842331, -0.006731437984853983, -0.028648894280195236, 0.02529468573629856, -0.000965979415923357, -0.0006786519079469144, -0.013522068038582802, 0.006724860984832048, 0.0014230726519599557, 0.047564003616571426, 0.027438748627901077, 0.011266198009252548, 0.003627150086686015, 0.01116754487156868, 0.010832123458385468, 0.02679421380162239, -0.023255852982401848, 0.023150622844696045, -0.002872452838346362, -0.008471023291349411, 0.043275877833366394, 0.011904154904186726, 0.0005545133026316762, 0.034331321716308594, 0.01665266416966915, 0.01799434795975685, -0.014219217002391815, -0.020006872713565826, 0.02247978001832962, -0.00573504064232111, 0.023005930706858635, 0.022900700569152832, -0.005011583678424358, 0.008819597773253918, 0.003212806535884738, -0.021230172365903854, 0.01907295547425747, -0.030569344758987427, 0.010036320425570011, -0.01467959862202406, 0.013903526589274406, -0.007418721914291382, -0.018546804785728455, -0.033594708889722824, -0.0324108712375164, 0.011141236871480942, 0.02219039760529995, 0.008148755878210068, -0.005409484729170799, -0.0008122448343783617, 0.011891000904142857, 0.004064512439072132, 0.004126993007957935, 0.0069254557602107525, 0.026688983663916588, 0.018691496923565865, -0.007523952051997185, -0.5838165879249573, -0.01817850023508072, -0.00937863253057003, 0.00047106912825256586, 0.025860296562314034, 0.01406137179583311, -0.012351383455097675, 0.02696521393954754, -0.0011221803724765778, -0.011378004215657711, -0.02486061118543148, 0.040881894528865814, 0.02201939933001995, 0.0041894735768437386, -0.02725459635257721, -0.01682366244494915, -0.006494670175015926, -0.0053667351603507996, -0.007681797258555889, 0.02190101519227028, -0.007497644517570734, 0.012634188868105412, -0.02086186781525612, -0.013173493556678295, -0.005521291866898537, 0.009917937219142914, 0.02651798538863659, -0.0003919410228263587, -0.014245525002479553, 0.0443807952105999, -0.00989820621907711, 0.03769868239760399, 0.011568734422326088, 0.01310114748775959, 0.05461442098021507, 0.002152284374460578, -0.030043194070458412, 0.041750043630599976, -0.000126399434520863, 0.03175318241119385, -0.029122430831193924, -0.024189770221710205, 0.013693067245185375, -0.005277947057038546, -0.0069254557602107525, -0.002451532520353794, 0.0019105840474367142, -0.01699466072022915, -0.02814905159175396, 0.01875726506114006, -0.003817879594862461, -0.00996397528797388, 0.007070147432386875, -0.012114615179598331, -0.017783887684345245, -0.0029497311916202307, 0.02618914097547531, -0.012568419799208641, -0.0021111788228154182, -0.0159292072057724, -0.013351068831980228, 0.014955827966332436, 0.01303537841886282, 0.010174435563385487, -0.004334164783358574, 0.03412086144089699, -0.01377198938280344, 0.011378004215657711, 0.024229230359196663, -0.019743798300623894, -0.013627298176288605, 0.006504535675048828, 0.009372055530548096, -0.02024364098906517, 0.02159847877919674, 0.016942046582698822, 0.02428184635937214, 0.003521919948980212, 0.014298140071332455, 0.00781991146504879, -0.0060540190897881985, 0.004922795575112104, 0.001941824215464294, -0.00044352843542583287, 0.009523323737084866, -0.011279351077973843, -0.04456494748592377, 0.01594235934317112, 0.016784200444817543, -0.03664638102054596, 0.013265569694340229, 0.0159292072057724, 4.9249538278672844e-05, -0.01844157464802265, 0.012259306386113167, 0.003627150086686015, -0.0443807952105999, -0.006478228140622377, -0.01229219138622284, 0.004403221886605024, -0.010227050632238388, -0.01623174361884594, 0.004508452024310827, 0.014455985277891159, 0.00017685645434539765, 0.005465388298034668, -0.011766040697693825, -0.010325703769922256, 0.038645755499601364, -0.01978325843811035, 0.008865635842084885, -0.018139038234949112, -0.014298140071332455, -0.007431875914335251, 0.004337453283369541, -0.01831003837287426, 0.011818655766546726, -0.0003738545929081738, 0.024229230359196663, -0.004709046799689531, -0.0024548210203647614, 0.012114615179598331, 0.014469138346612453, -0.013824604451656342, 0.013344491831958294, 0.01786280982196331, -0.008503907360136509, 0.015034751035273075, 0.0033213249407708645, -0.0016499750781804323, -0.005800809245556593, -0.0005442369147203863, 0.0014173178933560848, -0.011246467009186745, 0.021361710503697395, -0.01303537841886282, 0.002926712157204747, 0.006182268261909485, 0.02220355160534382, -0.02814905159175396, -0.029885347932577133, -0.0037027841899544, 0.010989968664944172, 0.019243953749537468, -0.0023134180810302496, -0.016705278307199478, 0.002563339425250888, -0.00924051832407713, -0.007787027396261692, 0.009503593668341637, -0.005675848573446274, 0.013587837107479572, -0.015968667343258858, 0.004794546402990818, -0.013666759245097637, 0.010154704563319683, -0.02233508974313736, -0.02650483138859272, 0.009365478530526161, -0.00212104432284832, 0.003709360957145691, 0.02770182304084301, -0.03517316281795502, -0.006195422261953354, -0.005235197488218546, -0.01353522203862667, -0.014035064727067947, -0.01370622031390667, -0.0038902251981198788, -0.02533414587378502, -0.005409484729170799, -0.023874079808592796, 0.014929520897567272, -0.015889745205640793, -0.02486061118543148, 0.014548061415553093, -0.002678434830158949, -0.0004184540593996644, 0.0019336030818521976, -0.012075154110789299, -0.009404940530657768, -0.02426869235932827, -0.012640765868127346, -0.004390068352222443, 0.027201980352401733, 0.026004988700151443, 0.007833065465092659, 0.038619447499513626, 0.0035909772850573063, 0.009411517530679703, -0.027333518490195274, 0.02336108312010765, -0.003633726853877306, 0.013508914038538933, 0.024807997047901154, -0.003227604553103447, 0.025347299873828888, 0.02620229497551918, -0.0060836151242256165, 0.026754753664135933, 0.0212959423661232, 0.020625099539756775, 0.01758658140897751, -0.006839956622570753, 0.009582515805959702, -0.022848086431622505, 0.010121820494532585, -0.01846788264811039, 0.0030352307949215174, 0.02038833126425743, -0.01759973354637623, -0.014692752622067928, -0.013127455487847328, -0.008431562222540379, 0.016613202169537544, 0.019099263474345207, -0.01027966570109129, 0.010608509182929993, 0.008194793947041035, -0.002083227038383484, 0.0031651242170482874, 0.0019533338490873575, -0.009516747668385506, -0.024242384359240532, -0.01563982293009758, 0.0022903988137841225, 0.016271203756332397, 0.0049359495751559734, -0.007070147432386875, -0.03554146736860275, -0.02454492077231407, 0.0009133644052781165, 0.023584695532917976, 0.022216705605387688, -0.0004418842145241797, -0.0296222735196352, 0.009003750048577785, -0.033726248890161514, 0.03840898722410202, 0.02278231643140316, 0.0023249275982379913, 0.0015578987076878548, 0.009543054737150669, -0.012305344454944134, 0.00543579226359725, 0.010384895838797092, 0.02920135296881199, 0.011128082871437073, -0.02250608801841736, -0.011720002628862858, -0.011180697940289974, 0.01095050759613514, -0.019296569749712944, 0.024505458772182465, 0.01377198938280344, -0.011766040697693825, 0.023571543395519257, -0.0007029041880741715, 0.00640917057171464, 0.03501531481742859, 0.02236139588057995, 0.0053667351603507996, -0.0047222007997334, 0.004709046799689531, 0.00040961639024317265, 0.029069814831018448, 0.009043212048709393, -0.028938276693224907, -0.0066196308471262455, -0.03396301344037056, 0.006178979761898518, 0.005235197488218546, -0.009674591943621635, -0.019151877611875534, -0.0006802961579523981, -0.00506419874727726, -0.029438121244311333, 0.008352639153599739, 0.021808939054608345, -0.002796818735077977, -0.0313059538602829, -0.042065732181072235, 0.016323819756507874, 0.00307304784655571, -0.0006042509921826422, -0.009503593668341637, 0.008471023291349411, -0.0333053283393383, -0.025649836286902428, 0.0032604888547211885, 0.007537106052041054, 0.007477913983166218, 0.02278231643140316, 0.021111788228154182, -0.004498586989939213, -0.015666130930185318, 0.028096437454223633, -0.025518300011754036, -0.032384563237428665, -0.011858116835355759, 0.022703394293785095, 0.02236139588057995, -0.01787596382200718, -0.007648912724107504, 0.013653605245053768, 0.008398677222430706, -0.021046020090579987, -0.007372683845460415, 0.013055109418928623, -0.02608391083776951, -0.0027047423645853996, -0.020611945539712906, -0.027570286765694618, -0.006586746778339148, -0.010523010045289993, -0.00046654752804897726, 0.005310831591486931, 0.005037891212850809, 0.013028801418840885, -0.020020026713609695, -0.016902584582567215, 0.009398363530635834, -0.02575506642460823, -0.006109922658652067, 0.06761033833026886, 0.013120878487825394, 0.0022229859605431557, 0.007477913983166218, -0.0020388332195580006, 0.016718432307243347, -0.016415895894169807, -0.007839642465114594, 0.01301564835011959, -0.01933603174984455, 0.014890058897435665, 0.0002811616868712008, 0.014968981966376305, -0.01450860034674406, -0.0037159379571676254, -0.008175063878297806, -0.0028757413383573294, -0.0049063535407185555, 0.03806699067354202, -0.016047589480876923, -0.004169742576777935, 0.014311294071376324, 0.0019895066507160664, 0.017954885959625244, -0.014613830484449863, -0.0034462858457118273, 0.00855652242898941, 0.04298649728298187, 0.02188786119222641, -0.003173345234245062, -0.004593951627612114, -0.011055737733840942, -0.029385505244135857, 0.0052121784538030624, -0.01420606393367052, 0.013397106900811195, 0.00543579226359725, 0.05250982195138931, -0.003327901940792799, -0.007754142861813307, 0.017981193959712982, 0.037461914122104645, 0.012930148281157017, -0.025084225460886955, 0.0015431008068844676, -0.013377376832067966, -0.0033196809235960245, -0.005406196229159832, 0.005379888694733381, -0.031490106135606766, 0.0296222735196352, 0.014311294071376324, -0.02935919724404812, -0.017928577959537506, 0.019178185611963272, 0.030727189034223557, -0.017389273270964622, 0.00210131355561316, -0.0004977877251803875, -5.3745450713904575e-05, -0.0038507638964802027, -0.02770182304084301, 0.00014479414676316082, -0.03296332806348801, 0.004350606817752123, -0.02859628014266491, 0.0061132111586630344, -0.028806740418076515, -0.02454492077231407, -0.010457240976393223, -0.02126963436603546, -0.0032308928202837706, -0.03630438446998596, -0.006780764553695917, 0.02278231643140316, 0.009062942117452621, 0.019086109474301338, -0.029385505244135857, -0.0056725600734353065, 0.035936079919338226, -0.02261131815612316, -0.036251768469810486, -0.01050327904522419, -0.020506715402007103, 0.015021597035229206, 0.01713935285806656, 0.016902584582567215, 0.0025682721752673388, -0.0010835411958396435, 0.015061058104038239, 0.0009552920237183571, 0.0017642483580857515, 0.01712619885802269, 0.007977756671607494, -0.013548375107347965, -0.006945186760276556, 0.0057646362110972404, 6.910863703524228e-06, -0.03711991757154465, -0.006859687156975269, -0.0009240517974831164, -0.030911341309547424, -0.01264734286814928, -0.006248037330806255, 0.000740721239708364, 0.0014354042941704392, 0.022453472018241882, -0.00864202156662941, -0.009108980186283588, -0.009431247599422932, 0.03572561964392662, 0.0031059321481734514, 0.009398363530635834, -0.017086736857891083, 0.008806443773210049, 0.030885035172104836, 0.004057935904711485, 0.025242069736123085, 0.0021046020556241274, -0.034147169440984726, -0.0016557298367843032, -0.00718853110447526, 0.026570599526166916, 0.021611632779240608, -0.020296255126595497, 0.024373922497034073, -0.00893798191100359, -0.020335717126727104, -0.012548689730465412, -0.010542741045355797, 0.016902584582567215, 0.005922481417655945, -0.0010818969458341599, -0.00032863853266462684, -0.042670805007219315, 0.0015398123068735003, -0.00015548158262390643, 0.02321639098227024, 0.005971807986497879, -0.0313059538602829, -0.018823035061359406, 0.012232999317348003, 0.003393670776858926, -0.0072740307077765465, 0.0014797982294112444, -0.02888566255569458, -0.014284986071288586, 0.015560900792479515, 0.020335717126727104, 0.008477600291371346, -0.014995289035141468, 0.006609765812754631, -0.021335402503609657, 0.011378004215657711, 0.014534907415509224, -0.04167111963033676, -0.02396615594625473, -0.017455043271183968, -0.004939237609505653, -0.004271684214472771, 0.02814905159175396, 0.0006330248434096575, 0.005254928022623062, -0.004321010783314705, -0.0021785919088870287, 0.012469766661524773, -0.009779822081327438, 0.01473221369087696, -0.021046020090579987, 0.02607075683772564, 0.0010925844544544816, 0.04188157990574837, -0.0021325538400560617, -0.022821778431534767, -0.00409410847350955, -0.0029760387260466814, 0.0018957860302180052, 0.002390696434304118, 0.003995455335825682, -0.05272027850151062, 0.021782631054520607, -0.007471336983144283, -0.0006930388626642525, 0.006951763294637203, 0.029859041795134544, 0.0015636534662917256, 0.031069187447428703, 0.0033163924235850573, 0.021743169054389, -0.0008060790132731199, 0.02578137442469597, -0.01920449361205101, 0.007477913983166218, -0.018704650923609734, 0.007293761242181063, -0.0020388332195580006, -0.015560900792479515, -0.007872526533901691, -0.011838385835289955, 0.006905725225806236, 0.027201980352401733, 0.019704336300492287, 0.012713111937046051, -0.027622900903224945, -0.0016047590179368854, 0.03406824544072151, -0.024952687323093414, -0.009687745943665504, 0.016560586169362068, -0.018665188923478127, -0.04677477851510048, -0.020598791539669037, -0.011766040697693825, -0.026833675801753998, -0.015902899205684662, -0.002502503339201212, -0.01967802830040455, 0.008997173979878426, -0.010246780700981617, -0.00498198764398694, -0.02126963436603546, -0.003919821232557297, 0.0416974276304245, -0.013258992694318295, 0.02975381165742874, 0.019414953887462616, 0.01266049686819315, -0.001856324728578329, -0.04032943770289421, 0.011601618491113186, 0.007977756671607494, 0.0012726265704259276, 0.015837129205465317, -0.0052121784538030624, -0.004416375886648893, 0.019099263474345207, 0.0094444015994668, -0.04522263631224632, -0.03099026530981064, 0.008615714497864246, 0.010897892527282238, 0.000720990588888526, -0.009733784012496471, 0.026399601250886917, -0.009339171461760998, 0.020335717126727104, -0.016849970445036888, -0.01654743403196335, -0.009187903255224228, -0.010989968664944172, -0.006507824175059795, 0.007135916035622358, -0.006672245915979147, 0.018652034923434258, 0.01846788264811039, -0.011522696353495121, 0.01786280982196331, -0.010601932182908058, -0.01992795057594776, -0.004899776540696621, -0.010338857769966125, 0.02888566255569458, 0.012765727005898952, 0.018073270097374916, 5.204985063755885e-05, 0.020638253539800644, 0.010490125976502895, -0.015823977068066597, -0.015166288241744041, 0.057666096836328506, 0.024295000359416008, -0.0006946831126697361, -0.020888175815343857, 0.026583753526210785, -0.0046005286276340485, 0.022427165880799294, -0.006767611019313335, -0.014692752622067928, -0.025794528424739838, 0.001575985224917531, 0.03277917578816414, 0.009181326255202293, 0.004439394921064377, -0.01565297693014145, -0.010411202907562256, -0.01712619885802269, -0.025965526700019836, -0.027728131040930748, 0.006336824968457222, -0.019730644300580025, -0.030490420758724213, 0.007951449602842331, -0.023321621119976044, 0.0001881604694062844, -0.02100655809044838, -0.016297511756420135, -0.0257682204246521, 0.033147480338811874, -0.039224520325660706, -0.012693380936980247, -0.014416524209082127, -0.010463817976415157, -0.008891943842172623, -0.031332261860370636, 0.019388645887374878, -0.002578137442469597, 0.043091725558042526, 0.002701454097405076, 0.0005360158393159509, -0.026294371113181114, 0.012548689730465412, 0.012634188868105412, -0.018520496785640717, 0.02799120731651783, 0.01303537841886282, -0.0010070849675685167, 0.007162223570048809, -0.03067457489669323, -0.028227973729372025, -0.0022591587621718645, 0.017928577959537506, -0.011226736009120941, -0.017165660858154297, -0.034199781715869904, 0.012239576317369938, -0.013942988589406013, 0.006050730589777231, 0.006807072088122368, -0.05135228857398033, -0.004449259955435991, -0.010884738527238369, 0.01699466072022915, -0.029517043381929398, 0.010878161527216434, -0.0345417819917202, -0.003298305906355381, -0.008280293084681034, -0.009891629219055176, 0.004288126714527607, -0.0026554157957434654, 0.0037751297932118177, 0.022900700569152832, -0.013232684694230556, 0.021690554916858673, 0.021822091192007065, -0.017165660858154297, 0.0004209204053040594, -0.014850597828626633, -0.02009894885122776, -0.027570286765694618, -0.012048846110701561, 0.0072148386389017105, 0.016573740169405937, -0.014048218727111816, -0.02801751345396042, -0.015363594517111778, -0.019717490300536156, -0.009621976874768734, -0.008806443773210049, 0.034041937440633774, -0.007951449602842331, -0.01206200011074543, 0.007326645776629448, 0.014390216208994389, -0.010148127563297749, 0.0076094516552984715, -0.027885977178812027, -0.0034989009145647287, 2.133632733603008e-05, 0.00929313339293003, 0.0339893214404583, -0.00562652200460434, -0.030490420758724213, -0.03859313949942589, 0.0031141533982008696, -0.0036139963194727898, 0.007530529052019119, 0.015008443035185337, -0.009707476943731308, 0.013180069625377655, -0.008661752566695213, 0.0047222007997334, -0.03156903013586998, -0.0041927616111934185, 0.002296975813806057, -0.055035341531038284, -0.003738956991583109, -0.01065454725176096, 0.010687432251870632, -0.025386761873960495, 0.006800495088100433, 0.007602874655276537, -0.007313491776585579, 0.05524580180644989, -0.006547285243868828, 0.0006663202657364309, -0.016481664031744003, 0.029727503657341003, 0.03141118586063385, 0.0019747086334973574, -0.013982449658215046, 0.006057307589799166, 0.022874392569065094, 0.0026915885973721743, -0.0008623935282230377, 0.00929313339293003, -0.010615086182951927, 0.007714681793004274, -0.0027655786834657192, -0.014771675691008568, 0.011963346973061562, -0.03988220915198326, 0.011884424835443497, -0.03783022239804268, 0.000810600642580539, 0.012193538248538971, -0.022243011742830276, -0.04193419590592384, 0.025242069736123085, 0.045354172587394714, -0.02856997214257717, -0.00588630884885788, 0.009108980186283588, -0.02501845546066761, -0.003798148827627301, -0.03338424861431122, 0.0065900348126888275, -0.021506402641534805, 0.0004153711488470435, -0.00011417055065976456, 0.0033295461907982826, -0.013548375107347965, -0.0014543128199875355, -0.0035416504833847284, -0.0345417819917202, -0.01640274189412594, 0.28580495715141296, -0.01741558127105236, -0.013824604451656342, 0.01681050844490528, 0.007787027396261692, 0.011029429733753204, 0.01728404313325882, 0.011075467802584171, 0.0012134346179664135, 0.0072608767077326775, -0.018941417336463928, 0.00013328461500350386, 0.018967725336551666, 0.002481128554791212, 0.01296303328126669, -0.04064512625336647, -0.0019599106162786484, -0.005610079504549503, -0.01965172216296196, -0.02722828835248947, 0.027517670765519142, -0.018428420647978783, -0.014929520897567272, -0.015074212104082108, 0.011706848628818989, 0.0006630318239331245, -0.01742873527109623, 0.0015603650826960802, 0.033568400889635086, 0.012719688005745411, -0.010424356907606125, -0.008523638360202312, -0.0016253117937594652, 0.0010942285880446434, -0.019454414024949074, -0.015981821343302727, 0.02920135296881199, 0.014626983553171158, 0.020335717126727104, -0.004370337817817926, 0.003972436301410198, -0.006899148225784302, 0.015271518379449844, 0.0013605923159047961, -0.01056904811412096, 0.03354209288954735, -0.009575938805937767, -0.017165660858154297, -0.01473221369087696, 0.017823347821831703, -0.025044763460755348, 0.0034923239145427942, 0.03427870571613312, 0.023190082982182503, 0.004031628370285034, 0.003538362216204405, 0.029964271932840347, -0.00915501918643713, 0.013929834589362144, -0.008898519910871983, 0.012463189661502838, 0.05335165932774544, -0.02384777180850506, 0.022887546569108963, -0.0063729980029165745, 0.004748508334159851, -0.011891000904142857, 0.005840270780026913, 0.027017828077077866, -0.018415266647934914, -0.013522068038582802, -0.01444283127784729, -0.003768553026020527, 0.0006778298411518335, -0.01740242727100849, -0.033857785165309906, 0.025662990286946297, 0.009536477737128735, 0.010621663182973862, 0.027280904352664948, 0.013311607763171196, -0.002203255193307996, 0.021046020090579987, -0.007852796465158463, -0.02888566255569458, -0.015981821343302727, 0.009148442186415195, 0.006991224829107523, -0.0006091836257837713, -0.01549513265490532, 0.008477600291371346, -0.004725489299744368, 0.015021597035229206, 0.005840270780026913, -0.005712021607905626, 0.031332261860370636, -0.0051661403849720955, 0.009365478530526161, -0.005162851884961128, 0.013087993487715721, -0.003007279010489583, -0.020164718851447105, 0.03943498060107231, 0.005721886642277241, -0.013416837900876999, -0.012627611868083477, 0.007004378363490105, 0.004008609335869551, 0.013758835382759571, -0.011476658284664154, -0.01191073190420866, -0.02336108312010765, -0.004692604765295982, -0.0041763195767998695, 0.004824142437428236, 0.0012940013548359275, -0.032095178961753845, -0.022098321467638016, -0.019862180575728416, -0.007484490983188152, 0.040566202253103256, -0.030016886070370674, -0.029280275106430054, 0.03604130819439888, -0.014337601140141487, -0.01467959862202406, -0.005504849832504988, -0.0005569796194322407, -0.012042270042002201, -0.010529587045311928, 0.023045392706990242, -0.015521439723670483, 0.01829688437283039, 0.01875726506114006, 0.008595983497798443, 0.010213896632194519, 0.014758521690964699, -0.002116111572831869, -0.0006909836083650589, -0.002971106208860874, 0.003433132078498602, -0.016705278307199478, 0.006652515381574631, 0.0030302980449050665, -0.00733979931101203, -0.026912597939372063, 0.004367049317806959, -0.01132538914680481, 0.035962387919425964, -0.0012389200273901224, -0.040697742253541946, -0.020204178988933563, -0.0026767905801534653, -0.003913244232535362, -0.010207319632172585, -0.009411517530679703, -0.03293702006340027, -0.008944558911025524, 0.017757579684257507, 0.024807997047901154, -0.04359157010912895, -0.006767611019313335, 0.031332261860370636, -0.019730644300580025, -0.019914796575903893, -0.028675202280282974, -0.1650007963180542, 0.01325241569429636, 0.022834932431578636, -0.036541152745485306, 0.028938276693224907, -0.01303537841886282, 0.01769181154668331, -0.01729719713330269, 0.009187903255224228, 0.008990596979856491, 0.038935136049985886, 0.029885347932577133, -0.011706848628818989, -0.01712619885802269, -0.020283101126551628, 0.005781078711152077, -0.041329123079776764, 0.02454492077231407, 0.0664001926779747, 0.014482292346656322, 0.046669550240039825, -0.007083300966769457, 0.01414029486477375, 0.004347318317741156, 0.020191024988889694, 0.03882990777492523, -0.0039165327325463295, -0.01682366244494915, -0.013245838694274426, -0.021769477054476738, -0.04680108651518822, -0.0019007186638191342, 0.01294987928122282, 0.00040160081698559225, 0.004676162730902433, -0.02636013925075531, 0.0002493048959877342, -0.003258844604715705, 0.00011889768211403862, 0.010523010045289993, 0.0033870937768369913, 0.008911673910915852, 0.010753201320767403, 0.010450663976371288, -0.0075502595864236355, 0.04451233148574829, 0.0014929519966244698, 0.0004599706444423646, -0.006073750089854002, -0.028333203867077827, 0.015139980241656303, -0.024308152496814728, 0.011200428940355778, 0.016179127618670464, 0.01577136106789112, 0.013041955418884754, 0.002025679452344775, 0.011897577904164791, -0.013679913245141506, 0.0010136618511751294, -0.0016351770609617233, -0.014837443828582764, 0.026912597939372063, 0.0028247705195099115, -0.0024548210203647614, 0.008589406497776508, -0.0052121784538030624, 0.0024646862875670195, -0.0354362353682518, 0.011535849422216415, -0.02530783973634243, 0.0006038399296812713, 0.03022734634578228, -0.03651484474539757, -0.01846788264811039, -0.0014666445786133409, -0.016047589480876923, 0.0054292152635753155, 0.042828649282455444, 0.014324447140097618, -0.013785143382847309, 0.03735668584704399, -0.013134031556546688, -0.002551829908043146, 0.00016842981858644634, 0.03272655978798866, 0.011042583733797073, -0.014048218727111816, -0.026123372837901115, -0.024913227185606956, 0.010253357701003551, -0.04774815961718559, -0.0025682721752673388, -0.014666445553302765, -0.006932032760232687, 0.005057621747255325, -0.01108862180262804, 0.019875334575772285, -0.001656551961787045, -0.02562353014945984, 0.0022394279949367046, -0.017455043271183968, 0.002461397787556052, 0.011746309697628021, 0.01065454725176096, 0.00718853110447526, -0.009437824599444866, 0.021822091192007065, 0.03648853674530983, 0.0003968736855313182, 0.010457240976393223, 0.011963346973061562, 0.019888488575816154, 0.025952372699975967, -0.004126993007957935, 0.02468961291015148, -0.028333203867077827, -0.011904154904186726, 0.042670805007219315, 0.006859687156975269, -0.004794546402990818, -0.007372683845460415, 0.010818969458341599, 0.01698150672018528, -0.018849341198801994, -0.009852168150246143, -0.037435609847307205, 0.005899462383240461, -0.007925141602754593, 0.024097692221403122, 0.007313491776585579, 0.020217332988977432, 0.0035449389833956957, 0.030306268483400345, -0.015232057310640812, 0.014337601140141487, -0.03054303675889969, -0.03780391439795494, 0.008655175566673279, -0.014640137553215027, 0.008392100222408772, -0.008576253429055214, -0.0032144507858902216, 0.009003750048577785, -0.0013457942986860871, 0.03648853674530983, -0.019243953749537468, -0.02604445070028305, 0.004209204111248255, 0.0037455339916050434, -0.015718746930360794, -0.02605760283768177, -0.034015629440546036, 0.01487690582871437, 0.01965172216296196, 0.022663932293653488, 0.017020968720316887, -0.014692752622067928, 0.020914481952786446, -0.027491364628076553, -0.01192388590425253, 0.011226736009120941, -0.025491992011666298, -0.0030056347604840994, -0.004399933386594057, -0.02712305821478367, 0.003817879594862461, -0.008839328773319721, 0.015126827172935009, -0.024058232083916664, 0.004248665180057287, -0.02132224850356579, -0.01511367317289114, 0.03285809978842735, 0.013147185556590557, -0.017941731959581375, -0.03083241917192936, -0.009641707874834538, -0.01482429075986147, -0.01992795057594776, 0.04335480183362961, 0.003362430492416024, 0.023150622844696045, 0.00428483821451664, -0.018257422372698784, -0.013956141658127308, -0.003886936930939555, -0.004031628370285034, -0.02529468573629856, 0.0038113025948405266, 0.028201667591929436, 0.0016433981945738196, 0.0017691811081022024, -0.01980956643819809, 0.024479152634739876, -0.01652112603187561, -0.026004988700151443, 0.011285928077995777, 0.0023413696326315403, 0.024084540084004402, -0.013693067245185375, -0.020769791677594185, -0.027280904352664948, -0.011779194697737694, 0.016455356031656265, -0.011858116835355759, -1.1355396964063402e-05, -0.0269389059394598, 0.010332280769944191, -0.022979622706770897, 0.007931718602776527, 0.004386779852211475, -0.013942988589406013, 0.010943930596113205, 0.0005873977206647396, -0.020611945539712906, 0.008286870084702969, -0.005705444607883692, -0.02011210285127163, -0.011805501766502857, -0.003298305906355381, 0.007392414379864931, 0.005873154848814011, 0.00998370535671711, 0.03301594406366348, 0.0002349179849261418, -0.0007884036167524755, -0.03940867260098457, -0.08134286850690842, 0.02841212786734104, 0.00368305342271924, 0.014179755933582783, 0.008543368428945541, 0.020611945539712906, 0.034910086542367935, -0.006100057158619165, -0.02471591904759407, -0.004725489299744368, -0.03251609951257706, 0.0318584144115448, 0.006218441296368837, -0.02384777180850506, -0.022085167467594147, -0.03751453012228012, -0.011147813871502876, 0.022848086431622505, 0.014968981966376305, 0.012469766661524773, 0.017152506858110428, 0.0063269599340856075, 0.009806130081415176, 0.02190101519227028, -0.003472593380138278, 0.02440022863447666, -0.0039625708013772964, 0.03293702006340027, -0.01154242642223835, -0.018099578097462654, -0.00937863253057003, -0.02636013925075531, 0.010523010045289993, 0.025794528424739838, 0.016481664031744003, -0.005360158160328865, 0.006899148225784302, 0.006287498399615288, 0.01979641243815422, 0.052325665950775146, -0.03872467577457428, -0.020638253539800644, 0.018967725336551666, 0.0026767905801534653, -0.022374549880623817, 0.005902750883251429, -0.006807072088122368, 0.00983243715018034, 0.05719256028532982, 0.005103659816086292, 0.02053302340209484, 0.014324447140097618, -0.012311921454966068, -0.007662066724151373, -0.021716861054301262, -0.04422295093536377, 0.01758658140897751, 0.01742873527109623, -0.002321639098227024, -0.025820836424827576, 0.02872781828045845, 0.008918250910937786, 0.01400875672698021, -0.0028823181055486202, 0.00825398601591587, -0.03380516916513443, -0.010628240182995796, -0.013061686418950558, 0.01759973354637623, -0.013653605245053768, 0.0006626207614317536, 0.0054292152635753155, -0.0034758816473186016, 0.036988381296396255, 0.014337601140141487, 0.03617284819483757, -0.004126993007957935, -0.0047879694029688835, -0.034305013716220856, 0.04453863948583603, -0.0023134180810302496, 0.0053667351603507996, -0.03735668584704399, 0.011950192973017693, 0.029990578070282936, -0.0025616951752454042, -0.000850884011015296, 0.007083300966769457, -0.0050937943160533905, 0.01191073190420866, -0.005715309642255306, -0.005902750883251429, -0.013732528313994408, 0.013285299763083458, -0.006188845261931419, 0.03540992736816406, 0.007543683052062988, -0.017520811408758163, 0.060349464416503906, 0.0093917865306139, 0.005159563384950161, -0.008918250910937786, 0.002754068933427334, -0.01370622031390667, 0.00018589965475257486, -0.01742873527109623, -0.025531454011797905, -0.04030312970280647, 0.012134346179664135, 0.018494190648198128, 0.0029102698899805546, 0.00662620784714818, -0.038198526948690414, 0.01919133961200714, -0.009365478530526161, -0.023150622844696045, -0.021993091329932213, -0.016915738582611084, -0.01095050759613514, 0.0333053283393383, 0.00710303196683526, -0.016600048169493675, 0.043696798384189606, -0.006534131709486246, 0.0028642318211495876, -0.0003070581587962806, 0.026859983801841736, -0.019401799887418747, 0.014521753415465355, -0.0023347928654402494, 0.01487690582871437, -0.005590348970144987, -0.010838700458407402, -0.005097082816064358, 0.031516414135694504, 0.01595551334321499, 0.003712649457156658, 0.01770496368408203, -0.01831003837287426, 0.03733037784695625, 0.005005006678402424, 0.0072740307077765465, 7.861428457545117e-05, 0.019625414162874222, 0.036988381296396255, 0.018494190648198128, 0.0015340575482696295, 0.0030483845621347427, -0.008207947947084904, -0.019165031611919403, -0.016284357756376266, 0.012857803143560886, -0.008891943842172623, -0.04517002031207085, 0.013548375107347965, -0.012219845317304134, 0.01833634451031685, -0.01859942078590393, -0.011713425628840923, 0.0226376261562109, 0.005669271573424339, 0.022848086431622505, 0.004725489299744368, -0.00924051832407713, -0.007398991379886866, 0.023111160844564438, -0.012173807248473167, 0.0062546138651669025, -0.019441261887550354, 0.016942046582698822, 0.00662620784714818, -0.022585010156035423, -0.0081027178093791, -0.004021762870252132, 0.003669899655506015, -0.020598791539669037, 0.0063565559685230255, 0.0162054356187582, 0.014416524209082127, -0.012653919868171215, 0.015902899205684662, -0.03354209288954735, -0.0033295461907982826, 0.02011210285127163, -0.009418093599379063, 0.021966783329844475, -0.013410260900855064, -0.005810674745589495], [0.00801441352814436, -0.0076480405405163765, 0.001643772586248815, 0.00814526155591011, -0.009283634833991528, 0.03948979824781418, 0.0018989254022017121, 0.0028328499756753445, -0.0032319349702447653, -0.03684667497873306, -0.012613705359399319, 0.011311772279441357, 0.0012945731868967414, -0.02346096932888031, 0.003092909464612603, 0.0004640999832190573, 0.02094869688153267, -0.003696443745866418, 0.02876029536128044, -0.012777265161275864, -0.005577377509325743, 0.0177691001445055, -0.004762851633131504, -0.011769738979637623, -0.014419401995837688, 0.016198929399251938, 0.03532884269952774, -0.019705643877387047, 0.011625806801021099, -0.01568862423300743, -0.005770377814769745, -0.02056923881173134, 0.009165871888399124, -0.015897979959845543, -0.001597158145159483, -0.02930985577404499, -0.022244086489081383, -0.0062348865903913975, -0.011422992683947086, 0.007883566431701183, 0.012299671769142151, -0.005449801217764616, -0.00363756250590086, 0.005384377669543028, -0.0158587247133255, 0.016146590933203697, -0.03472694382071495, 0.0012405985035002232, -0.029597720131278038, 0.03352314606308937, 0.00888455007225275, -0.008361159823834896, -0.011233263649046421, -0.01634286157786846, -0.031638942658901215, 0.02401052974164486, -0.01761208288371563, -0.006372276693582535, -0.010683704167604446, 0.01630360633134842, 0.005037631373852491, 0.01096502598375082, -0.005799818783998489, -0.010906144976615906, -0.023395545780658722, -0.02100103534758091, 0.024481579661369324, -0.005538123194128275, -0.026051750406622887, 0.011135128326714039, 0.03527650609612465, 0.011612721718847752, -0.004975478630512953, -0.005305869039148092, 0.03430823236703873, -0.011972553096711636, -0.006745192222297192, -0.009139702655375004, -0.00717698922380805, 0.007059226278215647, 0.01974489912390709, -0.039620645344257355, 0.028524769470095634, -0.001144098467193544, 0.01337262149900198, 0.0007020789780654013, -0.027870532125234604, 0.00792936235666275, 0.00029481592355296016, -0.028393922373652458, 0.014131537638604641, 0.031429585069417953, 0.008406956680119038, 0.018528016284108162, 0.018305575475096703, 0.01320906262844801, -0.010297703556716442, 0.010945399291813374, 0.00268564629368484, -0.01778218522667885, -0.028786465525627136, 0.005027818027883768, -0.004641817416995764, 0.013241774402558804, -0.03127256780862808, -0.00474322447553277, 0.013647401705384254, -0.021995477378368378, 0.024023614823818207, -0.01460258848965168, -0.012083773501217365, 0.021406661719083786, 4.932340016239323e-05, -0.038835559040308, -0.043389055877923965, -0.009918245486915112, 0.0199542548507452, -0.01323523186147213, -0.010860348120331764, 0.0038011218421161175, -0.00044488173443824053, 0.022558121010661125, 0.002636578632518649, -0.006247971672564745, 0.010003296658396721, -0.0050016483291983604, -0.03341846913099289, -0.009322889149188995, -0.0017648065695539117, -0.022505782544612885, 0.023107681423425674, 0.004471715539693832, 0.015727877616882324, -0.006120394915342331, -0.015387673862278461, 0.017023269087076187, -0.012836147099733353, -0.012221163138747215, -0.01249594334512949, -0.006126937456429005, -0.00011847838322864845, -0.009492991492152214, -0.004851173609495163, -0.026666734367609024, 0.009852821938693523, 0.0029048160649836063, 0.03292124718427658, 0.012574451044201851, 0.015492352657020092, 0.00968272052705288, 0.007530277594923973, 0.0020690271630883217, 0.015374589711427689, -0.00669939536601305, 0.0017386371036991477, -0.006902209483087063, 0.0102519067004323, 0.024599343538284302, -0.005711496341973543, 0.01022573746740818, 0.01935235597193241, 0.01826632022857666, 0.037971965968608856, -0.016879336908459663, -0.00792936235666275, 0.019417779520154, -0.01227350253611803, 0.006094225682318211, 0.01134448405355215, -0.011194009333848953, -0.0032074011396616697, -0.009996754117310047, -0.022845985367894173, 0.007798515260219574, -0.004707241430878639, 0.014628758653998375, 0.017258794978260994, 0.01046780589967966, -0.024690937250852585, -0.00388944405131042, -0.03231934830546379, -0.0102519067004323, 0.00031260302057489753, 0.0007912188884802163, 0.005861971061676741, -0.012705299071967602, -0.00486752949655056, 0.02275439165532589, -0.0009249287541024387, 0.0017222811002284288, 0.012149197049438953, 0.0453779362142086, -0.0036768168210983276, 0.004955851938575506, -0.626812219619751, -0.01854110136628151, -0.008099464699625969, -0.02476944588124752, 0.04412180185317993, 0.026274191215634346, -0.0025678835809230804, 0.038521524518728256, 0.0036931727081537247, 0.030121110379695892, 0.007327463943511248, 0.024455411359667778, 0.003369324840605259, 0.005462885834276676, -0.004939495585858822, -0.007340548560023308, 0.010618280619382858, -0.008001329377293587, 0.02072625420987606, -0.0196925587952137, -0.0153091661632061, 0.017638253048062325, -0.00825648196041584, -0.0050343601033091545, -0.004893699195235968, -0.0008676829747855663, 0.02750415913760662, -0.0087471604347229, -0.0056689707562327385, 0.0410076268017292, -0.033444639295339584, 0.028995821252465248, 0.009964042343199253, 0.011580009944736958, 0.056526150554418564, -0.017978455871343613, -0.007229328155517578, 0.034596096724271774, -0.004962394014000893, 0.01799154095351696, -0.005649344064295292, -0.025358259677886963, 0.01105007715523243, 0.0014957513194531202, 0.017428895458579063, -0.008132176473736763, 0.023853512480854988, -0.027922870591282845, -0.00937522854655981, 0.008354617282748222, -0.00402029138058424, 0.00679753115400672, 0.00899577047675848, -0.0015562683111056685, 0.00864248163998127, 0.0028557481709867716, 0.016604555770754814, -0.02280673198401928, 0.001815509982407093, 0.008596685715019703, 0.00631666649132967, 0.016761573031544685, -0.006856412626802921, 0.0028361210133880377, -0.015021300874650478, 0.028864974156022072, -0.029597720131278038, 0.01227350253611803, 0.02700693905353546, -0.008210685104131699, 0.008982685394585133, 0.013281028717756271, 0.007981701754033566, -0.006941463798284531, 0.012692213989794254, -0.002993138274177909, 0.021197305992245674, 0.0069610909558832645, -0.00619236147031188, -0.010493975132703781, 0.011017365381121635, 0.009329431690275669, -0.011481874622404575, -0.010984653607010841, 0.009610754437744617, -0.006637243088334799, -0.04119081422686577, 0.010794924572110176, 0.01678774319589138, -0.04823041334748268, 0.0011252891272306442, 0.01082763634622097, -0.0008214773843064904, -0.008819126524031162, 0.010389297269284725, 0.019012151286005974, -0.01608116552233696, 0.008269566111266613, 0.02148517034947872, -0.03598308190703392, 0.010186483152210712, -0.01203143410384655, -0.0032237570267170668, 0.002281654393300414, 0.005276428069919348, -0.00631666649132967, 0.0012332383776083589, 0.0059502930380403996, 0.015466182492673397, -0.022558121010661125, 0.041923560202121735, -0.01580638624727726, -0.011108959093689919, 0.01350346952676773, 0.002109917113557458, -0.027530329301953316, 0.009113533422350883, 0.008753702044487, 0.037265386432409286, -0.006725565064698458, -0.001418878324329853, 0.024743275716900826, 0.014563334174454212, -0.0006517844740301371, 0.029545381665229797, 0.029937924817204475, -0.008976142853498459, -0.011351026594638824, 0.006140022072941065, 0.0008652295800857246, -0.021642187610268593, -0.01145570445805788, 0.006597988773137331, -0.014471741393208504, 0.00861631240695715, 0.005423631984740496, -0.009492991492152214, -0.008112549781799316, 0.033392298966646194, -0.02576388604938984, -0.024900292977690697, 0.007196616381406784, 0.008295736275613308, 0.00801441352814436, 0.018410252407193184, -0.013339909724891186, -0.014039943926036358, -0.004955851938575506, -0.025305919349193573, -0.009192042052745819, 0.01011451706290245, -0.002621858147904277, -0.02203473076224327, 0.0060615139082074165, -0.008760244585573673, 0.01377824880182743, -0.009538787417113781, 0.005786733701825142, -0.019260762259364128, 0.0052993264980614185, 0.0022800189908593893, 0.030278127640485764, -0.03383718058466911, 0.0029653331730514765, 0.004321240819990635, -0.01821398176252842, 0.014877368696033955, 0.002754341345280409, -0.004232918843626976, -0.02488720789551735, 0.009479906409978867, -0.015322250314056873, -0.0051782927475869656, 0.0011988908518105745, -0.001180899329483509, -0.007975159212946892, -0.002662748098373413, 0.002880282234400511, 0.0047530378215014935, -0.013699740171432495, -0.008210685104131699, -0.015348419547080994, 0.004710512701421976, 0.008001329377293587, 0.031429585069417953, 0.01350346952676773, 0.02394510619342327, 0.002484468277543783, -0.007726549170911312, 0.027373312041163445, -0.017677506431937218, 0.03331379219889641, 0.02745182067155838, -0.018528016284108162, 0.02449466474354267, -0.019443949684500694, 0.025188157334923744, 0.0237880889326334, -0.00194472202565521, 0.00728820962831378, 0.02745182067155838, -0.004857716150581837, 0.016316691413521767, 0.0032482908573001623, 0.021393578499555588, -0.01630360633134842, 0.006777903996407986, -5.6581353419460356e-05, 0.03922810032963753, 0.023539477959275246, -0.010808009654283524, -0.0410076268017292, -0.02132815308868885, -0.03111555241048336, 0.004069359507411718, 0.024036698043346405, -0.013477299362421036, 0.017402727156877518, 0.009113533422350883, 0.011612721718847752, -0.008472380228340626, -0.007262039929628372, -0.005430174060165882, -0.02111879736185074, -0.016159674152731895, -0.0033480622805655003, 0.0016135141486302018, 0.0013640859397128224, -0.009447194635868073, -0.02165527269244194, -0.0006072145188227296, -0.0012242426164448261, 0.005829259287565947, 0.024154461920261383, -0.009178956970572472, -0.008655566722154617, 0.002770697232335806, -0.007739633787423372, 0.04184505343437195, -0.015165233053267002, -0.00605824263766408, 0.01657838746905327, 0.017350388690829277, -0.02051689848303795, 0.005250258836895227, 0.02493954636156559, 0.05270539969205856, 0.006545649841427803, 0.003588494611904025, 0.007033057045191526, -0.009277092292904854, 0.004847902338951826, -0.00765458308160305, 0.008426583372056484, 0.008413499221205711, -0.004177308641374111, 0.02860327810049057, 0.003052019514143467, 0.017088692635297775, 0.02910050004720688, 0.007340548560023308, 0.039672981947660446, -0.003843647427856922, -0.0021409932523965836, 0.015282995998859406, -0.01991499960422516, 0.0016339590074494481, -0.024586258456110954, -0.01952245831489563, -0.00891071930527687, -0.01930001750588417, -0.015008216723799706, 0.004667987115681171, -0.009650008752942085, 0.013712825253605843, 0.006385361310094595, -0.005770377814769745, 0.0010009838733822107, 0.03182213008403778, 0.00045755758765153587, -0.024376902729272842, -0.04469753056764603, 0.007955532521009445, -0.01372591033577919, -0.013326824642717838, -0.011972553096711636, -0.01718028634786606, -0.010644449852406979, -0.016329776495695114, 0.014798860065639019, -0.011324857361614704, 0.00508669950067997, 0.006313395220786333, 0.019378524273633957, 0.0014376876642927527, 0.014026859775185585, 0.03286891058087349, -0.025175072252750397, -0.014903537929058075, -0.007523735519498587, -0.016447540372610092, -0.011737027205526829, -0.015897979959845543, -0.008694821037352085, 0.03807664290070534, 0.004412834532558918, -0.013222146779298782, 0.0024615698494017124, -0.0064278868958354, -0.0224141888320446, -0.015086724422872066, -0.008289193734526634, -0.015230657532811165, 0.022571206092834473, -0.0010737678967416286, -0.018776627257466316, -0.004121698439121246, -0.010618280619382858, 0.034098878502845764, -0.00815180316567421, -0.02449466474354267, -0.02302917279303074, -0.0459536649286747, 0.012456689029932022, 0.047340650111436844, 0.0023732478730380535, -0.008714447729289532, 0.006333022378385067, 0.020765509456396103, -0.0026676547713577747, -0.020006593316793442, -0.00864248163998127, 0.0031763247679919004, -0.0016961116343736649, 0.014903537929058075, -0.007294752169400454, 0.017742929980158806, -0.014968962408602238, -0.002526993630453944, -0.0024664767552167177, -0.017978455871343613, -0.028917312622070312, 0.022296426817774773, -0.016826998442411423, 0.0012970265233889222, 0.006790989078581333, 0.010009839199483395, 0.009636923670768738, -0.017899947240948677, 0.014288554899394512, 0.0026970955077558756, 0.023395545780658722, 0.03203148394823074, -0.021511340513825417, 0.01482502929866314, 0.00036984882899560034, -0.02017669565975666, -0.0010312424274161458, -0.005518496502190828, 0.010722958482801914, -0.002394510433077812, 0.04009169712662697, 0.020045848563313484, -0.03085385635495186, 0.029990263283252716, 0.01602882705628872, 0.009741601534187794, -0.02750415913760662, 0.020032763481140137, -0.007693836931139231, 0.002708544721826911, 0.023984359577298164, -0.01630360633134842, -0.02739948034286499, 0.025633038952946663, 0.005760564468801022, -0.025148902088403702, -0.019600966945290565, 0.019129915162920952, 0.03362782672047615, -0.013922181911766529, 0.0158587247133255, 0.01323523186147213, 0.013189435005187988, -0.009447194635868073, -0.02658822573721409, 0.003066739998757839, -0.02965005859732628, -0.00798824429512024, -0.04660790413618088, -0.017585912719368935, -0.01180899329483509, -0.0022342223674058914, -0.009342516772449017, -0.022832900285720825, -0.009885533712804317, -0.053071774542331696, -0.03129873797297478, 0.01495587732642889, 0.01563628390431404, 0.02127581462264061, -0.05710187926888466, -0.02024211920797825, 0.010121059603989124, -0.03237168863415718, -0.0143539784476161, 0.007203158922493458, -0.02007201686501503, -0.016120420768857002, 0.011743569746613503, 0.008341532200574875, 0.004232918843626976, -0.003640833543613553, 0.0018629422411322594, 0.015950318425893784, 0.012587536126375198, -0.009931330569088459, 0.010932314209640026, -0.009591126814484596, 0.010297703556716442, 0.0006068056100048125, 0.0196925587952137, -0.021262729540467262, -0.009008855558931828, 0.032895080745220184, -0.026391955092549324, -0.005309140309691429, -0.026104090735316277, 0.018776627257466316, -0.011017365381121635, 0.011841705068945885, -0.013529638759791851, 0.011900586076080799, 0.01881588064134121, 0.027242464944720268, -0.0069610909558832645, -0.007111565675586462, -0.012096857652068138, 0.00013207425945438445, 0.02012435719370842, 0.008956516161561012, 0.007759260945022106, 0.015165233053267002, -0.024743275716900826, 8.116638491628692e-05, 0.0034314775839447975, 0.037762608379125595, 0.028943482786417007, -0.02346096932888031, 0.0067124804481863976, -0.010232280008494854, -0.03582606464624405, -0.009303262457251549, 0.016539132222533226, 0.005521767307072878, 0.01606808230280876, 0.00024983708863146603, -0.003621206618845463, -0.036009252071380615, 0.0011122043943032622, -0.028786465525627136, 0.015623199753463268, 0.0028001379687339067, -0.01561011467128992, -0.006948005873709917, -0.01761208288371563, 0.0016781201120465994, -0.009192042052745819, 0.005103055387735367, -0.02356564812362194, -0.015296081081032753, 0.0011359205236658454, 0.014223131351172924, 0.017756015062332153, 0.0030372992623597383, -0.004589478485286236, -0.019941169768571854, 0.011737027205526829, 0.021301984786987305, -0.028079887852072716, -0.03428206220269203, -0.005188106093555689, 0.015269911848008633, 0.001974162645637989, 0.02690226025879383, 0.004524054937064648, -0.007229328155517578, 0.007641497999429703, -0.005924123805016279, -0.004651631228625774, -0.011174382641911507, -0.0014327808748930693, -0.025842394679784775, 0.011534213088452816, 0.031037043780088425, 0.022649714723229408, 0.008027498610317707, 0.0075957016088068485, -0.00195126433391124, 0.005449801217764616, -0.0006575090228579938, -0.016421370208263397, -0.019600966945290565, -0.05511299520730972, 0.005093241576105356, -0.02165527269244194, 0.0025744258891791105, -9.849346679402515e-05, 0.038835559040308, -0.012129569426178932, 0.03679433837532997, -0.005430174060165882, 0.02368341013789177, -0.00572785222902894, 0.01871120184659958, -0.028577109798789024, 0.006480225827544928, -0.011154755018651485, -0.00042484569712542, -0.013032417744398117, 0.0016617641085758805, -0.013267943635582924, -0.007327463943511248, 0.0010974840261042118, 0.01249594334512949, 0.010238822549581528, 0.011252891272306442, -0.043179698288440704, -0.004409563262015581, 0.024311479181051254, -0.025004969909787178, 0.0008423312101513147, 0.013300655409693718, -0.013274486176669598, -0.009990211576223373, -0.03190063685178757, -0.027530329301953316, -0.012927739880979061, 0.009610754437744617, 0.03702986240386963, -0.015727877616882324, 0.018789710476994514, -0.018724286928772926, -0.022283341735601425, -0.015282995998859406, 0.003320257179439068, 0.03763176128268242, -0.010049093514680862, 0.030801517888903618, 0.012077230960130692, 0.0014597681583836675, -0.014196961186826229, -0.029021991416811943, 0.02093561179935932, 0.003595036920160055, -0.0018204167718067765, 0.031691282987594604, -0.0077919727191329, -0.00571476761251688, -0.007543362211436033, 0.0003218032361473888, -0.008917261846363544, -0.023369375616312027, 0.029336025938391685, 0.002504095435142517, -0.009826652705669403, -0.002919536316767335, 0.01520448736846447, -0.013581978157162666, 0.04637238010764122, -0.011239806190133095, -0.021079543977975845, 0.0008247485966421664, -0.007183531764894724, -0.017023269087076187, -0.005636258982121944, -0.015413844026625156, 0.01470726728439331, 0.029466873034834862, -0.02368341013789177, 0.018174728378653526, -0.011102416552603245, 0.0075957016088068485, 0.029937924817204475, -0.007785430643707514, 0.03922810032963753, -0.008544346317648888, 0.0038501897361129522, -0.010670619085431099, 0.030749179422855377, -0.02017669565975666, -0.0303566362708807, -0.01634286157786846, 0.04171420633792877, 0.019509373232722282, -0.0023830614518374205, -0.013379164040088654, 0.04239461198449135, 0.011795908212661743, 0.014903537929058075, -0.00021242284856271, -0.0243376474827528, 1.88348949450301e-05, -0.01031078863888979, 0.028681786730885506, 0.00017725756333675236, -0.006719022523611784, -0.02100103534758091, -0.014275469817221165, -0.010997738689184189, -0.000988716958090663, -0.008164888247847557, 0.01678774319589138, -0.040824443101882935, -0.022178662940859795, -0.008400414139032364, 0.011619264259934425, 0.01821398176252842, -0.005646072793751955, -0.0037095285952091217, -0.009859364479780197, 0.019417779520154, -0.04035339131951332, 0.02017669565975666, -0.02456008829176426, 0.0012790350010618567, -0.013581978157162666, 0.011252891272306442, 0.012594078667461872, -0.008845295757055283, 0.02745182067155838, -0.009591126814484596, -0.012803434394299984, -0.03370633348822594, 0.015544691123068333, 0.00399412214756012, -0.008989227935671806, 0.011396823450922966, -0.0018171456176787615, 0.006804073695093393, 0.0013747173361480236, -0.04783787205815315, -0.03417738527059555, 0.013110926374793053, -0.001848221872933209, 0.006306852679699659, 0.007229328155517578, -0.016382114961743355, 0.008177973330020905, -0.003369324840605259, -0.00913316011428833, 0.006591446232050657, -0.019875746220350266, -0.01022573746740818, -0.002626765053719282, 0.018187811598181725, -0.024206800386309624, -0.020150525495409966, -0.005109597463160753, -0.008236854337155819, -0.00859014317393303, 0.009466821327805519, -0.0009142974158748984, 0.004203478340059519, -0.003362782532349229, 0.010330415330827236, 0.004334325902163982, -0.0112070944160223, 0.009525703266263008, -0.011351026594638824, 0.016774658113718033, -0.02636578492820263, -0.02760883793234825, -0.022270256653428078, -0.011383738368749619, 0.018083134666085243, -0.0016576751368120313, 0.0011931662447750568, -0.02077859453856945, -0.009185499511659145, -0.013117468915879726, -0.004955851938575506, 0.006908751558512449, 0.014916623011231422, -0.014262384735047817, -0.019666390493512154, 0.006862955167889595, 0.013608147390186787, 0.0012307849247008562, 0.013922181911766529, -0.008119091391563416, -0.00020260928431525826, -0.03407270833849907, -0.004491342697292566, 0.001412336016073823, -0.010212653316557407, -0.01783452369272709, -0.02876029536128044, 0.0037651387974619865, -0.014563334174454212, 0.014877368696033955, 0.02093561179935932, -0.020634662359952927, -0.01847567781805992, -0.025148902088403702, -0.009224753826856613, -0.006169463042169809, -0.012757638469338417, 0.012764180079102516, -0.044592853635549545, 0.008361159823834896, 0.006836785469204187, -0.0022473069839179516, -0.023696495220065117, 0.004468444734811783, -0.006928378716111183, -0.008806041441857815, 0.027687346562743187, -0.00365064712241292, -0.016800828278064728, -0.0013223782880231738, -0.0003870225918944925, 0.014039943926036358, 0.014340893365442753, -0.027582667768001556, 0.019417779520154, 0.019823407754302025, 0.0024811970070004463, -0.020058931782841682, 0.007948989979922771, 0.002219501882791519, -0.01629052311182022, 0.0026512988843023777, -0.010166856460273266, 0.01821398176252842, -0.03922810032963753, 0.0018694846658036113, -0.027268633246421814, 0.004003935493528843, 0.0019283660221844912, -0.006653598975390196, 0.0023601630236953497, 0.015440013259649277, 0.018462592735886574, -0.02690226025879383, 0.013359537348151207, 0.0069610909558832645, -0.01555777620524168, -0.004219834227114916, -0.05239136889576912, 0.014537164941430092, -0.040274880826473236, 0.021315069869160652, -0.00012951865210197866, 0.012580993585288525, -0.014288554899394512, 0.008943431079387665, -0.010376212187111378, -0.036611150950193405, 0.0090219397097826, 0.26441678404808044, -0.026535887271165848, -0.00861631240695715, 0.002049400005489588, 0.0010165220592170954, 0.01859343983232975, 0.03166511282324791, 0.009728516452014446, -0.0037782236468046904, 0.02029445767402649, -0.04074593260884285, 0.0024354003835469484, 0.017376556992530823, 0.0024648411199450493, 0.02684992179274559, -0.02881263568997383, -0.011252891272306442, -0.0046483599580824375, -0.01996733993291855, -0.007589159067720175, 0.016159674152731895, 0.0034282063134014606, -0.006323209032416344, -0.007831227034330368, 0.014223131351172924, 0.009931330569088459, -0.016539132222533226, -0.0052666147239506245, 0.013137095607817173, 0.008760244585573673, -0.00448480062186718, -0.004281986504793167, 0.0016184209380298853, 0.006614344660192728, -0.004874072037637234, -0.022545035928487778, 0.023094596341252327, -0.00035594627843238413, 0.006902209483087063, -0.000796943495515734, 0.02478252910077572, 0.015780216082930565, 0.013581978157162666, -0.0006660959334112704, -0.01082763634622097, 0.035956911742687225, -0.007890108041465282, -0.01394835114479065, 0.005861971061676741, 0.00946027971804142, -0.013529638759791851, 0.017860693857073784, 0.027373312041163445, 0.02204781584441662, 0.0017288235248997808, 0.007379802875220776, 0.01984957605600357, -0.00328754517249763, -0.0061498358845710754, -0.0015570861287415028, 0.02280673198401928, 0.028315413743257523, -0.0158587247133255, 0.005361479241400957, -0.007608786225318909, 0.001154729863628745, -0.04095529019832611, -0.023003002628684044, -0.0006566912634298205, -0.02466476708650589, 0.011200551874935627, -0.00508669950067997, -0.0021655273158103228, -0.001048416132107377, -0.021616019308567047, -0.006908751558512449, 0.023591816425323486, 0.010565941222012043, 0.01957479678094387, 0.021629102528095245, -0.013791333884000778, 0.0180438794195652, 0.012953909114003181, 0.0011629078071564436, 0.0005332038272172213, -0.03504097834229469, 0.011135128326714039, -0.010781839489936829, -0.015897979959845543, -0.03260721266269684, 0.021903883665800095, -0.03477928414940834, 0.0172326248139143, 0.009970584884285927, -0.01303896028548479, 0.02001967839896679, -0.0047693937085568905, -0.003634291235357523, -0.006342836190015078, 0.007059226278215647, 0.00787702389061451, -0.011697772890329361, 0.024756360799074173, 0.02237493358552456, -0.006015717051923275, -0.011351026594638824, 0.014340893365442753, 0.006777903996407986, -0.01299316342920065, -0.014144622720777988, -0.0026300360914319754, -0.046450886875391006, -0.0020314084831625223, -0.014890453778207302, -0.012332383543252945, -0.004425919149070978, -0.02476944588124752, -0.018004626035690308, -0.009708889760077, -0.014785774983465672, 0.011004280298948288, -0.019731814041733742, -0.028969652950763702, 0.011599637567996979, -0.009499534033238888, -0.013182892464101315, -0.001270039239898324, 0.0004119653895031661, 0.019705643877387047, -0.018200896680355072, 0.021341238170862198, -0.0221524927765131, 0.021890798583626747, -0.001491662347689271, -0.00521100452169776, 0.03488396108150482, 0.008276108652353287, -0.019548626616597176, 0.011835162527859211, 0.003611393040046096, 0.027818193659186363, -0.0018204167718067765, 0.0027232649736106396, 0.004304884932935238, 0.004445546306669712, -0.01042200904339552, 0.024847954511642456, -0.009303262457251549, 0.016473708674311638, 0.005364750511944294, -0.0552176758646965, -0.008662109263241291, 0.010893059894442558, 0.001127742463722825, 0.01265950221568346, -0.021589849144220352, -0.030225789174437523, -0.014563334174454212, 0.011933298781514168, 0.007831227034330368, -0.022126324474811554, -0.013333367183804512, 0.03532884269952774, -0.023055341094732285, -0.01011451706290245, -0.02991175465285778, -0.16612407565116882, 0.009630381129682064, 0.020137440413236618, -0.02356564812362194, 0.020438389852643013, 0.00195126433391124, 0.016761573031544685, -0.03258104622364044, 0.0024615698494017124, 0.0023290866520255804, 0.012325841002166271, -0.0025891463737934828, -0.007334006484597921, 0.011985637247562408, -0.0019528999691829085, 0.012417434714734554, -0.01211648527532816, 0.0029506126884371042, 0.061550695449113846, 0.020320627838373184, 0.038207489997148514, 0.018397169187664986, -0.0006546467775478959, 0.010958484373986721, 0.018070049583911896, 0.029780907556414604, -0.015282995998859406, 0.004746495746076107, -0.017899947240948677, -0.0012127934023737907, -0.030775347724556923, 0.027635006234049797, 0.02576388604938984, 0.0024403072893619537, 0.004223105497658253, -0.007471396122127771, -0.029179008677601814, -0.013686656020581722, -0.020595407113432884, 0.0047693937085568905, 0.008963058702647686, 0.023997444659471512, 0.00388290174305439, 0.003369324840605259, -0.01118746679276228, 0.0338895209133625, -0.0016576751368120313, -0.0067648193798959255, -0.012842688709497452, -0.028132228180766106, -0.02411520667374134, -0.01492970809340477, 0.007484481204301119, 0.004546952899545431, 0.007706922013312578, 0.0010631365003064275, -0.0019201880786567926, 0.020634662359952927, -0.0019381796009838581, 0.013843673281371593, -0.003555782837793231, -0.018724286928772926, 0.030827688053250313, 0.02537134476006031, -0.02077859453856945, 0.017468150705099106, -0.009578041732311249, 0.005754021927714348, -0.017742929980158806, -0.003931969404220581, -0.018253235146403313, -0.030592162162065506, 0.02461242862045765, -0.02482178434729576, 0.0017435438930988312, -0.010245365090668201, -0.015623199753463268, -0.01205760333687067, 0.029780907556414604, 0.00260550226084888, -0.006823700852692127, 0.04603217542171478, -0.010101431980729103, -0.020425306633114815, -0.00019453353888820857, 0.02980707585811615, -0.01755974441766739, -0.019653305411338806, -0.02658822573721409, -0.019457032904028893, 0.03025195747613907, -0.019888831302523613, -0.006993802729994059, -0.016656896099448204, -0.01165197603404522, 0.001385348616167903, 0.0004015384765807539, -0.0016699421685189009, -0.008269566111266613, 0.0031141722574830055, -0.005171750206500292, -0.021903883665800095, -0.030487483367323875, 0.018554184585809708, 0.013078214600682259, -0.0028688330203294754, 0.014694182202219963, 0.0077527184039354324, 0.04325820505619049, -0.011259433813393116, 0.02225717157125473, 0.014772690832614899, 0.008930346928536892, 0.028236905112862587, -0.004190393257886171, 0.024246055632829666, -0.005384377669543028, -0.018802795559167862, 0.019862661138176918, -0.008361159823834896, -0.001792611670680344, -5.108677578391507e-05, 0.019679473713040352, 0.012083773501217365, -0.0011032086331397295, -0.004789020866155624, -0.07118108123540878, 0.019077574834227562, -0.017428895458579063, 0.023330122232437134, 0.013516553677618504, 0.0014908445300534368, 0.008164888247847557, 0.035852234810590744, -0.00017183966701850295, 0.011750111356377602, -0.01359506230801344, -0.03263338282704353, -0.025659209117293358, -0.024376902729272842, 0.0057801916263997555, -0.008688278496265411, -0.0009944415651261806, -0.02461242862045765, 0.015727877616882324, 0.02975473739206791, -0.019535541534423828, -0.00436376640573144, -0.0016846624203026295, -0.016499878838658333, -0.0015979759627953172, -0.014903537929058075, -0.025515276938676834, 0.02428530901670456, 0.013856757432222366, 0.012096857652068138, 0.02904815971851349, -0.029021991416811943, 0.004834817722439766, -0.004275444429367781, 0.006104039028286934, -0.00018829782493412495, -0.03394186124205589, 0.0032057655043900013, 0.020687000826001167, -0.0344390794634819, 0.009708889760077, -0.0030945450998842716, 0.0014147893525660038, -0.010081805288791656, -0.004160952754318714, 0.02547602169215679, 0.006771361920982599, 0.02876029536128044, -0.02684992179274559, -0.00728820962831378, -0.0404842384159565, -0.013896011747419834, -0.02318619005382061, -0.007353633642196655, 0.02876029536128044, 0.019116830080747604, 0.015021300874650478, 0.005361479241400957, -0.02980707585811615, -0.010193025693297386, -0.007916278205811977, -0.01684008166193962, -0.012162281200289726, 0.02531900443136692, 0.020202863961458206, -0.006365734152495861, -0.008734075352549553, -0.0109388567507267, -0.0046843430027365685, -0.0034020368475466967, -0.016107335686683655, 0.03046131506562233, -0.01580638624727726, 0.05273156985640526, -0.021746866405010223, -0.014157706871628761, -0.022191748023033142, -0.013922181911766529, 0.014537164941430092, -0.016434455290436745, -0.0026202225126326084, -0.02805371955037117, -0.0007200705586001277, -0.02734714187681675, 0.001187441754154861, -0.01684008166193962, 0.002572790253907442, 0.014484826475381851, -0.004455359652638435, -0.005260072182863951, 0.0023896037600934505, -0.0035067149437963963, 0.01074258517473936, -0.042525459080934525, 0.012973536737263203, 0.0034151216968894005, -0.006591446232050657, -0.01755974441766739, 0.0064998529851436615, -0.012796892784535885, -0.009885533712804317, -0.015675539150834084, -0.06662758439779282, 0.01668306440114975, 0.006987260188907385, 0.00716390460729599, 0.008511634543538094, 0.008400414139032364, 0.044488172978162766, -0.0174943208694458, -0.007556447293609381, -0.006689582020044327, -0.013922181911766529, 0.039960846304893494, 0.004304884932935238, -0.005325496196746826, -0.016198929399251938, -0.024455411359667778, 0.010873433202505112, 0.021838460117578506, 0.004160952754318714, 0.0042623598128557205, 0.014877368696033955, 0.011122043244540691, 0.0057965475134551525, -0.005381106398999691, -0.035904571413993835, 0.011900586076080799, -0.026928430423140526, 0.030330466106534004, -0.01008834782987833, -0.0118940444663167, -0.00035206173197366297, -0.02521432749927044, 0.015112894587218761, 0.026548972353339195, 0.019810322672128677, -0.006601260043680668, 0.01690550521016121, -0.00014965690206736326, 0.04160952568054199, 0.0486752949655056, -0.04168803617358208, -0.030827688053250313, 0.02258429117500782, 0.002345442771911621, -0.04019637405872345, 0.020163610577583313, -0.010722958482801914, 0.017638253048062325, 0.023199275135993958, -0.013163265772163868, 0.029179008677601814, 0.022073986008763313, 0.017533574253320694, -0.007517192978411913, 0.005044173914939165, -0.046948108822107315, 0.010565941222012043, 0.003899257630109787, 0.007458311505615711, -0.0041184271685779095, 0.01875045709311962, 0.01200526487082243, 0.024599343538284302, 0.008577058091759682, -0.0041707661002874374, -0.019443949684500694, -0.010539771988987923, -0.017428895458579063, -0.011763196438550949, -0.027320973575115204, -0.006725565064698458, 0.00047800253378227353, -0.01249594334512949, 0.005459615029394627, 0.01375207956880331, 0.01492970809340477, 0.000345519365509972, -0.012731468304991722, -0.016107335686683655, 0.038914065808057785, 0.00042811688035726547, 0.006189090199768543, -0.035904571413993835, 0.027216294780373573, 0.007523735519498587, 0.00717698922380805, -0.0005364750395528972, -0.013765164650976658, -0.0047334106639027596, 0.008498549461364746, 0.002206417266279459, 0.00339876557700336, -0.00025188157451339066, -0.006558734457939863, 0.01601574197411537, 0.031246399506926537, -0.0010157042415812612, -0.016997098922729492, 0.008321905508637428, 0.01630360633134842, 0.007379802875220776, 0.013542723841965199, -0.010068720206618309, 0.00040951199480332434, -0.0021491714287549257, -0.0017680778400972486, -0.015897979959845543, -0.022126324474811554, 0.01805696450173855, 0.03208382427692413, -0.0077919727191329, 0.015793301165103912, -0.01606808230280876, 0.028289245441555977, -0.019548626616597176, -0.007811599876731634, -0.021236561238765717, -0.06008520349860191, -0.022780561819672585, 0.04051040858030319, 0.015767132863402367, -0.005685327108949423, 0.018357913941144943, -0.009270550683140755, 0.02034679800271988, -0.004720326047390699, 0.001266768085770309, -0.02012435719370842, 0.0002024048299062997, -0.002999680582433939, 0.009748144075274467, -0.018671948462724686, -0.017036354169249535, -0.009224753826856613, 0.0005884051788598299, 0.024481579661369324, -0.002499188529327512, 0.04315352812409401, -0.03320911154150963, 0.03755325451493263, -0.0005070343613624573, -0.0029522483237087727, 0.009937873110175133, 0.018200896680355072, 0.010212653316557407, 0.011547298170626163, -0.005129224620759487, 0.0001969869335880503, -0.01892055943608284, -0.01876354217529297, -0.020058931782841682, 0.024298394098877907, -0.006333022378385067, -0.02965005859732628, -0.0034543757792562246, -0.018894389271736145, 0.0265228021889925, -0.01317634992301464, -0.005878326948732138, 0.030042601749300957, 0.020595407113432884, 0.028864974156022072, 0.015021300874650478, -0.004425919149070978, -0.007078853435814381, 0.01602882705628872, -0.025057310238480568, 0.016486793756484985, -0.027268633246421814, 0.028995821252465248, -0.0024288580752909184, -0.006365734152495861, -0.012299671769142151, 0.02110571227967739, -0.004353953059762716, -0.0029686042107641697, 0.01129214558750391, 0.006346106994897127, 0.01457641925662756, 0.004537139553576708, 0.014196961186826229, -0.03422972559928894, -0.015282995998859406, 0.02007201686501503, -0.0036735455505549908, -0.0019234592327848077, 0.008851838298141956, -0.010951941832900047], [-0.009037727490067482, -0.023080965504050255, 0.008534527383744717, 0.016181835904717445, 0.025027552619576454, 0.029476894065737724, -0.009547547437250614, -0.002911604708060622, -0.014169037342071533, -0.03824315965175629, 0.006233714520931244, 0.0026649709325283766, -0.013758532702922821, -0.028179170563817024, -0.02215401828289032, -0.012467429041862488, 0.020816566422581673, 0.0001771129755070433, 0.02429923787713051, -0.04896925389766693, 0.013453965075314045, 0.012288660742342472, -0.0012422737199813128, -0.013156017288565636, -0.03225773572921753, 0.018724316731095314, 0.02240561880171299, -0.033025775104761124, 0.008832475170493126, 0.004790326580405235, 0.009388642385601997, 0.0013233814388513565, 0.014804657548666, -0.013314922340214252, 0.010957830585539341, -0.028629401698708534, -0.008845716714859009, 0.008527906611561775, -0.019982315599918365, -0.006683945655822754, 0.014526573941111565, -0.004634731914848089, 0.004085185006260872, -0.0031152020674198866, -0.02114761993288994, 0.014579541981220245, -0.03278741613030434, 0.010196410119533539, -0.008739780634641647, 0.016340740025043488, 0.02359740622341633, -0.002880154876038432, -0.020472273230552673, -0.021121134981513023, -0.01297724898904562, 0.017969517037272453, -0.02249831333756447, -0.00872653815895319, -0.008951653726398945, 0.016446677967905998, 0.033184681087732315, 0.02165081910789013, -0.009997778572142124, -0.014089585281908512, -0.005809967406094074, -0.006409171968698502, -0.005949009675532579, -0.00018580308824311942, -0.02649742364883423, 0.017227960750460625, 0.01520192064344883, 0.009540926665067673, 0.0011462685652077198, 0.008971516974270344, 0.017069054767489433, -0.004830052610486746, -0.02566317282617092, -0.01979692652821541, 0.008263064548373222, 0.006309856660664082, 0.014010132290422916, -0.017916548997163773, 0.01800924353301525, -0.0009857082040980458, 0.010620157234370708, 0.026828477159142494, -0.03874635696411133, 0.015916993841528893, -0.016128867864608765, 0.0023537816014140844, 0.004436100367456675, 0.004436100367456675, 0.006773329805582762, 0.008892063982784748, 0.03050977736711502, 0.007812833413481712, -0.009666726924479008, 0.03911713883280754, 0.005127999931573868, -0.039434947073459625, -0.01939966343343258, 0.012970628216862679, -0.01517543662339449, 0.0030357493087649345, -0.040388379245996475, -0.01999555714428425, 0.024180058389902115, -0.010242757387459278, 0.010083852335810661, -0.02000880055129528, -0.00872653815895319, 0.006283372174948454, 0.008991380222141743, -0.03676004335284233, -0.028391042724251747, 0.005055168177932501, 0.037634022533893585, 0.001297724898904562, -0.007097760681062937, -0.005790104158222675, -0.003063888754695654, 0.011295503936707973, 0.00602515134960413, 0.011851671151816845, 0.011269019916653633, 0.0183535385876894, -0.006104603875428438, 0.001761198160238564, 0.0012828275794163346, -0.02365037426352501, 0.025994224473834038, -0.010136820375919342, 0.023928457871079445, -0.010587051510810852, -0.007534749805927277, 0.017837096005678177, -0.013930680230259895, 0.010593673214316368, 0.0056510623544454575, -0.026828477159142494, 0.01240121852606535, 0.010381799191236496, -0.005141241941601038, -0.02055172622203827, 0.006584629882127047, 0.023716585710644722, 0.04552631080150604, 0.005621267482638359, 0.015996446833014488, 0.00822995975613594, 0.025583719834685326, -0.013083186000585556, 0.018327053636312485, -0.01939966343343258, 0.004879710730165243, -0.008137265220284462, 0.01684393920004368, 0.0263650044798851, 0.004446031991392374, 0.011653040535748005, 0.01630101352930069, 0.02265721745789051, 0.038428548723459244, -0.01959829404950142, -0.0059788040816783905, 0.01965126395225525, 0.0014433879405260086, 0.016671793535351753, 0.01550648920238018, -0.009382021613419056, -0.003194654593244195, 0.006574698258191347, -0.025543993338942528, 0.020829809829592705, -0.004883021116256714, 0.017069054767489433, 0.008607359603047371, 0.0027742180973291397, -0.005793415009975433, -0.004191122017800808, -0.027384644374251366, -0.014433879405260086, 0.016115624457597733, -0.0002654625568538904, 0.009620379656553268, -0.017532529309391975, 0.002370334230363369, -0.00595232006162405, 0.005369667895138264, 0.006309856660664082, 0.019293727353215218, 0.03744863346219063, -0.004489068873226643, -0.0018687901319935918, -0.6157042980194092, -0.01864486373960972, -0.00842196960002184, -0.014804657548666, 0.030642198398709297, 0.01550648920238018, -0.0025391709059476852, 0.022776396945118904, 0.001388764358125627, 0.020485514774918556, -0.00824982300400734, 0.026020709425210953, 0.013076565228402615, 0.017135266214609146, -0.01864486373960972, -0.01022289413958788, 0.0025044104550033808, -0.005674235988408327, -0.0007258321275003254, 0.01570511981844902, -0.006578008644282818, 0.021664060652256012, -0.018393265083432198, -0.014235247857868671, -0.00877288542687893, -0.015307857654988766, 0.019677747040987015, -0.0020343163050711155, -0.007951876148581505, 0.021081408485770226, -0.028126202523708344, 0.021717028692364693, 0.007640686817467213, 0.008514665067195892, 0.06091361865401268, -0.007561234291642904, -0.0023239869624376297, 0.02170378714799881, 0.0025093762669712305, 0.021491913124918938, -0.013169259764254093, -0.012242313474416733, 0.009236359037458897, 0.003007609862834215, 0.013540037907660007, -0.00148476951289922, 0.01804897002875805, -0.025689657777547836, -0.014566300436854362, 0.019479116424918175, -0.008044570684432983, 0.014116069301962852, 0.000666656531393528, 0.00228260550647974, -0.004747289698570967, -0.0008077675593085587, 0.014023374766111374, -0.0037872381508350372, -0.012699165381491184, 0.009587273932993412, -0.0026235892437398434, 0.00458838464692235, -0.004085185006260872, -0.009719694964587688, -0.029026664793491364, 0.020843051373958588, -0.029344474896788597, 0.003462806809693575, 0.019690990447998047, -0.012288660742342472, -0.002011142671108246, 0.0029347785748541355, 0.01889646425843239, -0.008150506764650345, 0.017876822501420975, -0.009819010272622108, 0.02730519138276577, 0.004816810600459576, -0.0027411128394305706, 0.005508710164576769, -0.010024262592196465, -0.009640241973102093, -0.013540037907660007, 0.019386421889066696, -0.00015238749620039016, 0.0023984736762940884, -0.04597654193639755, 0.000746936711948365, 0.011858292855322361, -0.02860291674733162, 0.01830057054758072, 0.029609315097332, 0.004949231632053852, -0.024722984060645103, 0.006372756324708462, 0.00648862449452281, -0.042480628937482834, 0.0054756049066782, 0.007759865373373032, -0.007223560940474272, -0.004254021681845188, -0.008547769859433174, -0.00551533093675971, -0.0035257067065685987, 0.022273197770118713, -0.013314922340214252, -0.018618380650877953, 0.0037773065268993378, 0.02990064211189747, -0.027543550357222557, 0.008931790478527546, -0.016685035079717636, -0.017611980438232422, -0.01283158641308546, 0.0009004622115753591, -0.019518842920660973, 0.01382474321871996, -0.005879488307982683, 0.0360184870660305, -0.01781061291694641, 0.014711963012814522, 0.019479116424918175, 0.006213851273059845, -0.016632067039608955, 0.022180503234267235, 0.016274530440568924, -0.0018704453250393271, 0.012911038473248482, 0.004757221322506666, -0.004522174131125212, -0.0045585897751152515, -0.012195966206490993, 0.016022929921746254, -0.004214295651763678, 0.0016097417101264, -0.011964228935539722, 0.0026136578526347876, -0.013745290227234364, 0.02746409736573696, -0.03400569036602974, -0.026033950969576836, -0.0011032316833734512, 0.0212535560131073, 0.024577321484684944, 0.031833987683057785, -0.010931346565485, -0.03056274726986885, -0.014049858786165714, -0.03781941160559654, -0.007832696661353111, -0.010514220222830772, -0.00972631573677063, -0.017373623326420784, 0.014764931984245777, -0.015930235385894775, 0.01965126395225525, -0.0023223317693918943, -0.009156906045973301, -0.017532529309391975, -0.009209874086081982, 0.01005074754357338, 0.024617047980427742, -0.027596518397331238, 0.015148952603340149, 0.010116958059370518, -0.026735782623291016, 0.013189123012125492, -0.00932243186980486, -0.026523908600211143, -0.03924955800175667, 0.0024895132519304752, -0.009832252748310566, 0.007945254445075989, 0.006405861582607031, -0.010732715018093586, 0.009064211510121822, -0.021134378388524055, -0.0016867113299667835, 0.002610347233712673, -0.012679302133619785, 0.003694543382152915, -0.014884110540151596, -0.0034164595417678356, -0.0021419082768261433, 0.027993781492114067, 0.012844828888773918, 0.046082478016614914, 0.02910611592233181, -0.00924960058182478, 0.007647307589650154, -0.0063760667107999325, 0.012864691205322742, 0.005790104158222675, -0.0222467128187418, 0.010547325946390629, -0.03294632211327553, 0.019690990447998047, 0.01939966343343258, -0.0007804557681083679, 0.026166372001171112, 0.043089766055345535, 0.009474716149270535, 0.004922747611999512, -0.00415139552205801, 0.017678191885352135, -0.011295503936707973, 0.013321544043719769, -0.012712407857179642, 0.03050977736711502, 0.018764043226838112, -0.005240557715296745, -0.025345362722873688, -0.026391487568616867, -0.012540260329842567, -0.0030671993736177683, 0.023027997463941574, 0.0018836874514818192, 0.014063101261854172, 0.012613091617822647, -0.002762631280347705, -0.01570511981844902, -0.010408283211290836, -0.004777084570378065, -0.013864469714462757, -0.009805768728256226, -0.026417972519993782, 0.013175880536437035, 0.014553057961165905, -0.003290659748017788, -0.004985647276043892, -0.010606914758682251, -0.0026566945016384125, 0.022127535194158554, 0.015387309715151787, -0.011613314040005207, -0.021981870755553246, 0.0023686790373176336, -0.015241647139191628, 0.013692322187125683, 0.005094894673675299, 0.011772219091653824, -0.005422636400908232, 0.008686811663210392, -0.018830252811312675, 0.018485959619283676, -0.005922525189816952, 0.04470530152320862, 0.01285144966095686, -0.006541593000292778, -0.024670016020536423, -0.011957608163356781, 0.0077797286212444305, -0.0347207635641098, 0.01865810714662075, 0.001812511240132153, -0.03530341386795044, 0.023292837664484978, -0.004346716217696667, 0.038084253668785095, 0.037581056356430054, 0.010997557081282139, 0.026245824992656708, -0.026325277984142303, 0.0029662284068763256, 0.010011021047830582, 0.018962673842906952, 0.0173603817820549, -0.0035190857015550137, -0.035886067897081375, -0.013943921774625778, -0.004697632044553757, -0.02335904911160469, 0.0029397441539913416, -0.015307857654988766, 0.01060029398649931, -0.005031994543969631, -0.025345362722873688, 0.0018423058791086078, 0.008534527383744717, -0.001416076091118157, -0.03085407242178917, -0.04359296336770058, -0.007203697692602873, -0.006534972228109837, -0.010679746977984905, -0.01517543662339449, -0.012646197341382504, -0.01620831899344921, -0.01340099610388279, -0.0014500089455395937, 0.0001624225260457024, 0.008633843623101711, 0.014460363425314426, 0.018777284771203995, -0.009044348262250423, 0.010169926099479198, 0.03106594644486904, -0.017069054767489433, -0.029741736128926277, -0.026974139735102654, -0.012109892442822456, 0.007627444341778755, -0.02265721745789051, -0.00977266300469637, 0.024537594988942146, 0.02449786849319935, -0.0023885422851890326, 0.0022693632636219263, -0.012440945021808147, -0.025332121178507805, -0.005737136118113995, -0.012844828888773918, -0.004591695033013821, -0.0031334098894149065, -0.01900240033864975, 0.005177657585591078, 0.018128423020243645, -0.011434545740485191, 0.026537150144577026, -0.008415348827838898, -0.020022042095661163, -0.001966450596228242, -0.02365037426352501, -0.009156906045973301, 0.048280663788318634, 0.009620379656553268, -0.007773107383400202, 0.009494579397141933, 0.015029773116111755, 0.008024707436561584, -0.017611980438232422, 0.007700276095420122, 0.022882333025336266, -0.0058265202678740025, 0.020035283640027046, -0.004720805678516626, 0.015930235385894775, 0.006088051479309797, 0.0019300348358228803, -0.009620379656553268, -0.022538039833307266, -0.016314256936311722, 0.02420654334127903, -0.017876822501420975, -0.000448162027169019, 0.001121439621783793, 0.010474493727087975, 0.016896909102797508, -0.011461029760539532, 0.01387771125882864, 0.012142997235059738, 0.031224850565195084, 0.0418185256421566, -0.010911483317613602, 0.012639575637876987, -0.011699387803673744, -0.020233916118741035, 0.0014127655886113644, -0.009315811097621918, 0.00972631573677063, 0.004664526786655188, 0.030033063143491745, 0.007355981506407261, -0.0073824659921228886, 0.01635398343205452, 0.033078745007514954, 0.010169926099479198, -0.021213829517364502, 0.0022544660605490208, -0.013142775744199753, 0.010686367750167847, 0.016632067039608955, -0.004363269079476595, -0.021584609523415565, 0.0341116264462471, -0.004419547971338034, -0.030827587470412254, -0.010593673214316368, 0.030880557373166084, 0.03760753944516182, 0.0008317688480019569, 0.017174992710351944, 0.005866246297955513, -0.009170148521661758, -0.005263731349259615, -0.02521294169127941, -0.0065515246242284775, -0.028285106644034386, 0.003555501578375697, -0.008143885992467403, -0.007230181712657213, -0.017347140237689018, -0.02249831333756447, -0.010255999863147736, -0.01810193806886673, -0.013626111671328545, -0.049843233078718185, -0.0241535734385252, 0.019426148384809494, 0.011063767597079277, 0.03164859861135483, -0.038984715938568115, -0.016963118687272072, 0.029238536953926086, -0.020988713949918747, -0.010189789347350597, 0.008104159496724606, -0.02561020478606224, -0.006458830088376999, 0.012705786153674126, 0.000253048085141927, -0.011209430173039436, -0.0034164595417678356, 0.019624779000878334, 0.011507377028465271, 0.009421748109161854, 0.024127090349793434, 0.020432546734809875, -0.020737115293741226, -0.009766042232513428, 0.0019316900288686156, 0.004929368384182453, -0.03080110438168049, -0.0067766401916742325, 0.03056274726986885, -0.04277195408940315, -0.006369445938616991, -0.006117846351116896, 0.005177657585591078, -0.014049858786165714, 0.022286439314484596, -0.008521285839378834, 0.00824982300400734, 0.014407395385205746, 0.027490580454468727, 0.004866468720138073, 0.008395485579967499, -0.010871756821870804, -0.008435212075710297, 0.017347140237689018, 0.013288438320159912, 0.011209430173039436, -0.0025937946047633886, -0.01435442641377449, 0.015003289096057415, -0.0032956255599856377, 0.014460363425314426, 0.025583719834685326, -0.004839984234422445, 0.013096428476274014, -0.011520619504153728, -0.042586565017700195, -0.008369001559913158, -9.186700481222942e-05, 0.016420193016529083, 0.02656363509595394, -0.008845716714859009, -0.016181835904717445, -0.04777746647596359, -0.008958274498581886, -0.0051511735655367374, -0.0033072123769670725, -0.00551533093675971, -0.013215607032179832, -0.013414238579571247, 0.018168149515986443, 0.014513332396745682, -0.02876182273030281, 0.004469205625355244, -0.030536262318491936, 0.0012646197574213147, 0.004459274001419544, 0.005154483951628208, -0.0008085952140390873, 0.010606914758682251, -0.0016262943390756845, -0.021319767460227013, 0.011838429607450962, 0.011659661307930946, -0.03061571530997753, -0.0347207635641098, -0.002184945158660412, 0.014036616310477257, -0.008428591303527355, 0.03040384128689766, 0.001901895389892161, 0.006541593000292778, 0.006187367253005505, -0.01604941487312317, 0.008766264654695988, -0.0036481961142271757, -0.01250053383409977, -0.02635176107287407, 0.02545129880309105, 0.009918326511979103, 0.03787238150835037, 0.030086031183600426, -0.009521063417196274, 0.005707341246306896, 0.004131532274186611, 0.01100417785346508, 0.001890308572910726, -0.012295281514525414, -0.03254906088113785, 0.011321987956762314, -0.019638020545244217, 0.004810189828276634, 0.009064211510121822, 0.032125312834978104, -0.009938189759850502, 0.02470974251627922, -0.008812611922621727, 0.026245824992656708, -0.001954863779246807, 0.0528094582259655, -0.028232138603925705, 0.015162194147706032, -0.01012357883155346, 0.0009592240094207227, -0.0001405937655363232, -0.0012133065611124039, -0.009739558212459087, -0.01250053383409977, 0.02500106766819954, 0.007700276095420122, -0.007183834444731474, 0.013036838732659817, -0.01889646425843239, -0.022895576432347298, 0.027384644374251366, -0.03180750459432602, -0.024418415501713753, -0.003277417505159974, -0.014672237448394299, -0.033476006239652634, -0.04012353718280792, -0.02685496024787426, -0.02905314788222313, 0.006213851273059845, 0.028046749532222748, -0.029847674071788788, 0.018419748172163963, -0.013983648270368576, -0.01745307631790638, -0.015321099199354649, -0.004366579465568066, 0.03959385305643082, -0.017214719206094742, 0.028285106644034386, 0.006131088361144066, 0.0017843717942014337, -0.0016817456344142556, -0.03773995861411095, 0.009646863676607609, -0.0005739618791267276, 0.019187789410352707, 0.030191967263817787, -0.006505177356302738, -0.010990935377776623, 0.007395708002150059, 0.022829364985227585, -0.01945263147354126, -0.02366361767053604, 0.03575364500284195, 0.023425258696079254, -0.00691237160935998, -0.011745735071599483, 0.00792539119720459, -0.003972627222537994, 0.03466779366135597, -0.01785033941268921, -0.019717473536729813, -0.01205030269920826, -0.007309634238481522, -0.018340297043323517, 0.017439834773540497, 0.00957403238862753, 0.017863580957055092, -0.004515552893280983, -0.018538927659392357, 0.02245858684182167, 0.007236802950501442, -0.030721651390194893, 0.0018191322451457381, -0.01338113285601139, 0.033290617167949677, -0.009865357540547848, -0.0031367202755063772, -0.014698721468448639, 0.02701386623084545, 0.0034032175317406654, -0.02406087890267372, -0.015930235385894775, 0.04902222007513046, 0.005372978281229734, 0.002886775881052017, -0.004393063951283693, 0.054239604622125626, 0.006945476867258549, 0.002049213508144021, -0.00048085342859849334, -0.018221117556095123, -0.0024878578260540962, -0.007892286404967308, 0.007395708002150059, 0.002011142671108246, 0.008402107283473015, -0.012652818113565445, -0.007839318364858627, -0.012659438885748386, -0.031595628708601, -0.01517543662339449, 0.028020264580845833, -0.026444455608725548, -0.04160664975643158, 0.008163749240338802, -0.0068395403213799, 0.02440517395734787, -0.008713295683264732, -0.01669827662408352, 0.0008541148854419589, 0.017572255805134773, -0.03625684604048729, 0.015413793735206127, -0.02519970014691353, -0.010759199038147926, 0.00461155828088522, -0.0049558524042367935, 0.02044578827917576, -0.0031698255334049463, 0.035382866859436035, -0.005849693901836872, -0.012288660742342472, -0.018869979307055473, -0.0006194815505295992, 0.0017198165878653526, -0.02665632963180542, 0.012268797494471073, 0.031542662531137466, 0.01273227110505104, -0.004350027069449425, -0.018538927659392357, -0.025583719834685326, 0.00014431810996029526, -0.003932901192456484, -0.005045236553996801, 0.011434545740485191, -0.029980095103383064, 0.007038171403110027, 0.00957403238862753, -0.011189566925168037, 0.003810411784797907, -0.028682369738817215, -0.002994367852807045, -0.011487513780593872, 0.011070388369262218, -0.05137931555509567, -0.008494801819324493, -0.005495467688888311, -0.007077897898852825, -0.018922949209809303, -0.0011868224246427417, -0.01950559951364994, 0.00456190062686801, -0.014937078580260277, 0.030536262318491936, 0.00882585346698761, 0.0031516177114099264, 0.015215163119137287, -0.010434768162667751, -0.01864486373960972, -0.019638020545244217, -0.005207452457398176, -0.014023374766111374, -0.01981016807258129, 0.012811723165214062, -0.0022908817045390606, -0.0146325109526515, -0.019889621064066887, -0.00365150673314929, -0.009481336921453476, -0.024524353444576263, 0.004184500779956579, 0.022869091480970383, -0.010381799191236496, -0.014473605901002884, 0.01155372429639101, 0.012692544609308243, -5.664097625412978e-05, 0.013420859351754189, -0.020419305190443993, 0.01460602693259716, -0.010083852335810661, -0.021995114162564278, 0.007984980940818787, -0.011997334659099579, -0.02165081910789013, -0.022643975913524628, 0.007216939702630043, -0.009037727490067482, 0.012315144762396812, 0.031145397573709488, 0.004935989622026682, 2.0871812012046576e-05, -0.02089601941406727, -0.019227515906095505, -0.016287771984934807, -0.008998000994324684, 0.003654817119240761, -0.049737293273210526, -0.011692766100168228, 0.01228203997015953, 0.01600968837738037, -0.028285106644034386, 0.011838429607450962, -0.012387976050376892, -0.0024448211770504713, 0.0222467128187418, -0.012685922905802727, -0.01427497435361147, -0.004224227275699377, 0.0052537997253239155, 0.004647973924875259, 0.008057812228798866, -0.014023374766111374, 0.013083186000585556, 0.014407395385205746, 0.004667837172746658, 0.0014500089455395937, 0.013334785588085651, -0.005442499648779631, -0.004409616347402334, 0.004909505136311054, -0.0027675970923155546, -0.005157794337719679, -0.03011251613497734, -0.000488302088342607, -0.028841273859143257, -0.009911704808473587, 0.01158020831644535, -0.02089601941406727, -0.009269463829696178, 0.011302124708890915, 0.014208763837814331, -0.04187149181962013, 0.02065766230225563, 0.004462584853172302, -0.03035087324678898, -0.007528129033744335, -0.034694280475378036, 0.010613536462187767, -0.04044134542346001, 0.00021083891624584794, 0.01595672033727169, 0.01865810714662075, -0.021928902715444565, 0.0020889397710561752, 0.006147640757262707, -0.044784750789403915, -0.01999555714428425, 0.28560543060302734, -0.010136820375919342, -0.022167259827256203, 0.02470974251627922, 0.008408728055655956, 0.011970850639045238, 0.018830252811312675, 0.01382474321871996, -0.01660558208823204, -0.0024961342569440603, -0.029291504994034767, -0.0022792948875576258, -0.00298774684779346, -0.004254021681845188, 0.010315588675439358, -0.007144108414649963, -0.010659883730113506, -0.005220694467425346, -0.007475160527974367, -0.02515997365117073, 0.01860513724386692, -0.0011901329271495342, -0.009514442645013332, -0.0138512272387743, 0.007475160527974367, -0.0120767867192626, 0.004942610394209623, -0.005194210447371006, 0.021928902715444565, 0.025027552619576454, -0.011169703677296638, -0.0019896242301911116, 0.008408728055655956, 0.015400552190840244, 0.003681301372125745, -0.016486402601003647, 0.021717028692364693, 0.001491390517912805, 0.033476006239652634, -0.0063793775625526905, 0.011070388369262218, 0.015572698786854744, 0.009759421460330486, 0.013314922340214252, -0.013771775178611279, 0.030827587470412254, -0.013010354712605476, -0.017863580957055092, 0.009375400841236115, -0.0010419870959594846, -0.030483294278383255, 0.011494135484099388, 0.017691433429718018, 0.025941256433725357, 0.0018836874514818192, 0.005283594597131014, 0.009521063417196274, -0.006180746015161276, -0.0027907707262784243, -0.006187367253005505, 0.0037309592589735985, 0.033343587070703506, -0.0157978143543005, 0.016168592497706413, -0.02341201715171337, -0.003810411784797907, -0.036336299031972885, -0.016565855592489243, 0.013506933115422726, -0.022339407354593277, 0.008428591303527355, -0.005396152380853891, 0.0011090250918641686, -0.008600737899541855, -0.01477817352861166, -0.019677747040987015, 0.01600968837738037, 0.012659438885748386, 0.03233718499541283, 0.010474493727087975, -0.003780617145821452, 0.011348471976816654, 0.012301902286708355, -0.02604719251394272, -0.006660772021859884, -0.011070388369262218, 0.0003134651342406869, 0.003591917222365737, -8.83495740708895e-05, -0.010209652595221996, 0.01730741374194622, -0.012752133421599865, 0.01585078239440918, -0.0004144360718782991, -0.016420193016529083, 0.022418860346078873, -0.0075546130537986755, 0.003116857260465622, -0.0006496901041828096, -0.0035720542073249817, -0.01845947466790676, -0.0418185256421566, 0.016486402601003647, 0.01570511981844902, -0.010633398778736591, -0.015969961881637573, 0.014910594560205936, 0.019121579825878143, -0.006614424753934145, -0.027834875509142876, -0.0173603817820549, -0.03591255098581314, -5.084756048745476e-05, -0.007627444341778755, -0.0032741071190685034, -0.012394597753882408, -0.02314717508852482, -0.01714850775897503, -0.013665838167071342, 0.019717473536729813, 0.010944588109850883, -0.0203001257032156, -0.031145397573709488, 0.022816123440861702, 0.0014930458273738623, -0.020313367247581482, 0.01691015064716339, -0.00503861578181386, -0.007216939702630043, -0.020869536325335503, 0.018327053636312485, -0.02411384880542755, 0.02950337901711464, 0.0009890187066048384, -0.004935989622026682, 0.015188678167760372, -0.006617735140025616, -0.014990047551691532, -0.004522174131125212, 0.0030936836265027523, 0.017029330134391785, -0.01517543662339449, 0.010593673214316368, 0.009858736768364906, 0.001366418320685625, -0.005237246863543987, 0.01900240033864975, 0.00408849585801363, 0.015930235385894775, -0.016195077449083328, -0.0283115915954113, -0.012937523424625397, 0.0005963079165667295, -0.000800318899564445, 0.02564993128180504, -0.02854994870722294, -0.0386139377951622, -0.011136598885059357, 0.010520840995013714, 0.013215607032179832, -0.04136829450726509, -0.008468316867947578, 0.025928014889359474, -0.04020299017429352, 0.0033965962938964367, -0.02170378714799881, -0.1686512678861618, 0.008501422591507435, 0.0049558524042367935, -0.026417972519993782, 0.02640472911298275, -0.0075546130537986755, 0.003014231100678444, -0.011235914193093777, -0.008746401406824589, -0.0024448211770504713, 0.013930680230259895, -0.013414238579571247, -0.011619934812188148, 0.010878377594053745, -0.016089141368865967, 0.012308523990213871, -0.018327053636312485, 0.0016842284239828587, 0.056782085448503494, 0.023292837664484978, 0.04661216214299202, -0.00738908676430583, 0.013083186000585556, 0.0031731361523270607, 0.013758532702922821, 0.03824315965175629, -0.021624334156513214, 0.0057569993659853935, -0.011911260895431042, -0.00834913831204176, -0.011613314040005207, 0.011335230432450771, 0.03636278212070465, -0.010342073626816273, 0.012268797494471073, -0.019028885290026665, -0.019412904977798462, -0.0009575686999596655, -0.00882585346698761, 0.004859847482293844, 0.001339934067800641, 0.031171882525086403, -0.003995800856500864, 0.011368335224688053, -0.011725871823728085, 0.038084253668785095, 0.003406527917832136, -0.012083408422768116, -0.004949231632053852, -0.03061571530997753, 0.006664082407951355, -0.015162194147706032, -9.569479880155995e-05, 0.002981125842779875, -0.007786349393427372, 0.024590563029050827, -0.00115040666423738, 0.027834875509142876, -0.016115624457597733, -0.002421647310256958, 0.0075016445480287075, -0.021372735500335693, 0.032840386033058167, 0.0177444014698267, -0.01875080168247223, 0.01050097867846489, -0.0025474473368376493, 0.0038997959345579147, -0.03278741613030434, 0.005998667329549789, -0.027834875509142876, -0.01680421456694603, 0.018843496218323708, -0.024696500971913338, -0.013837985694408417, -0.0011785461101680994, -0.007455297280102968, 0.0061542619951069355, 0.0328139029443264, 0.0033005911391228437, -0.019412904977798462, 0.05315375328063965, -0.028496980667114258, -0.01925400085747242, 0.007912149652838707, 0.03535638377070427, -0.005445810034871101, -0.011712629348039627, -0.008633843623101711, -0.01581105776131153, 0.03249609097838402, -0.033476006239652634, 0.016473161056637764, -0.022776396945118904, -0.016115624457597733, 0.011315367184579372, -0.0028420838061720133, 0.007197076454758644, -0.006918992847204208, -0.00738908676430583, -0.00813064444810152, -0.013348028063774109, -0.013957164250314236, 0.009686589241027832, 0.006303235422819853, 0.009693210944533348, 0.011235914193093777, 0.0047506000846624374, 0.04910167306661606, -0.007422192022204399, 0.0036018488463014364, -0.0049790265038609505, 0.02321338653564453, 0.017227960750460625, 0.00693885562941432, 0.028338074684143066, -0.004843294620513916, -0.0034859804436564445, 0.02905314788222313, -0.004846605472266674, -0.009593894705176353, -0.014976805076003075, 0.012692544609308243, -0.003245967673137784, 0.0028172549791634083, -0.013864469714462757, -0.0618140809237957, 0.013559901155531406, -0.014288216829299927, 0.014685478992760181, 0.001953208353370428, 0.010732715018093586, 0.005839762277901173, 0.049340032041072845, -0.0019565189722925425, 0.005783483386039734, -0.01844623312354088, -0.03225773572921753, -0.0004676113312598318, -0.006597871892154217, 0.006352893076837063, -0.013864469714462757, 0.0138512272387743, 0.003949453588575125, 0.015360825695097446, 0.038084253668785095, -0.023478228598833084, 0.00085825304267928, 0.013665838167071342, -0.01242770254611969, -0.007634065579622984, -0.011361714452505112, -0.03106594644486904, 0.031198367476463318, 0.025742625817656517, -0.0006232059095054865, 0.02651066705584526, -0.02114761993288994, -0.0001969761069631204, -0.028629401698708534, 0.011984092183411121, -0.007448676507920027, -0.029370957985520363, 0.002436544746160507, 0.002466339385136962, -0.03760753944516182, 0.006578008644282818, 0.0035621225833892822, 0.021094651892781258, -0.006965340115129948, 0.009156906045973301, -0.015413793735206127, -0.010692988522350788, 0.023690100759267807, -0.022617490962147713, -0.00868019089102745, -0.03180750459432602, -0.008647085167467594, -0.015307857654988766, -0.011619934812188148, 0.03562122583389282, 0.015374068170785904, 0.015029773116111755, -0.005171036813408136, -0.0283115915954113, 0.0012877933913841844, -0.01849920116364956, -0.01114984042942524, -0.0060814302414655685, 0.022140776738524437, 0.03877284377813339, -0.01775764487683773, -0.004449342843145132, -0.017016086727380753, 0.004330163821578026, -0.007759865373373032, -0.022895576432347298, 0.01845947466790676, -0.008991380222141743, 0.03829612955451012, -0.02110789343714714, -0.004942610394209623, -0.029821189120411873, -0.01342748012393713, 0.015016531571745872, 0.002943054772913456, -0.01435442641377449, -0.02854994870722294, 0.01247404981404543, -0.03294632211327553, 0.018737558275461197, -0.0066740140318870544, -0.008296170271933079, 0.013639354147017002, -0.016062656417489052, 0.00025118590565398335, 0.00596556207165122, 0.023941701278090477, -0.006045014597475529, -0.02395494282245636, 0.007951876148581505, 0.02055172622203827, -0.005843072663992643, -0.01460602693259716, 0.01710878126323223, 0.00206907675601542, -0.009004621766507626, -0.03954088315367699, -0.06435656547546387, 0.014063101261854172, 0.013043459504842758, 0.012063545174896717, 0.021637577563524246, 0.016181835904717445, 0.01595672033727169, 0.007865802384912968, -0.00965348444879055, -0.010335451923310757, -0.021094651892781258, 0.043487027287483215, 0.013785016722977161, -0.008594117127358913, -0.020723871886730194, -0.02950337901711464, -0.002838773187249899, -0.003156583523377776, 0.014063101261854172, 0.014023374766111374, 0.007024929393082857, 0.0021932213567197323, 0.015890508890151978, 0.004323542583733797, -0.020035283640027046, 0.023875489830970764, -0.011566966772079468, 0.03683949634432793, -0.015599183738231659, -0.005654372740536928, -0.01790330745279789, -0.014063101261854172, 0.013169259764254093, 0.024987826123833656, 0.024775952100753784, -0.012599850073456764, -0.0008847372373566031, 0.011461029760539532, 0.05116743966937065, 0.04716832935810089, -0.03556825593113899, -0.01935993693768978, 0.02231292426586151, -0.011143219657242298, -0.03231070190668106, 0.025795593857765198, -0.005776862148195505, 0.005382909905165434, 0.026987381279468536, -0.004608247894793749, 0.016446677967905998, 0.029529863968491554, 0.00048416396020911634, -0.011825187131762505, -0.021995114162564278, -0.05137931555509567, 0.020075010135769844, -0.00028656714130192995, 0.006045014597475529, -0.011269019916653633, 0.0007440400077030063, 0.02150515653192997, 0.026391487568616867, 0.017347140237689018, 0.004816810600459576, -0.01799600198864937, -0.0060383933596313, -0.017466317862272263, 0.0277024544775486, -0.03829612955451012, 0.01193112414330244, 0.0030738203786313534, 0.0017429902218282223, 0.007369223516434431, 0.008600737899541855, 0.011706008575856686, -0.02044578827917576, -0.0202603992074728, -0.006385998334735632, 0.04295734316110611, 0.0018936190754175186, 0.029423926025629044, -0.031728051602840424, 0.007859180681407452, 0.016618823632597923, 0.01322884950786829, 0.006405861582607031, -0.0046810791827738285, -0.019042126834392548, -0.0031896887812763453, -0.0020475583150982857, -0.0075744763016700745, -0.009295947849750519, 0.01140144094824791, 0.0014930458273738623, 0.048439569771289825, 0.0024431657511740923, -0.02141246199607849, 0.030721651390194893, 0.006084741093218327, 0.004015664104372263, 0.013069944456219673, -0.005429257173091173, -0.013036838732659817, -0.00461486866697669, -0.020882777869701385, -0.012937523424625397, -0.02815268561244011, 0.010428146459162235, 0.000938533223234117, -0.007740002125501633, -0.010606914758682251, -0.018936190754175186, 0.016274530440568924, -0.005942388437688351, -0.0003747098089661449, -0.03511802479624748, -0.03215179592370987, -0.019677747040987015, 0.04881034791469574, 0.02366361767053604, -0.001056884415447712, 0.01069960929453373, -0.003959385212510824, 0.02186269313097, 0.010361935943365097, 0.010798925533890724, -0.023292837664484978, 0.01705581322312355, 0.008455075323581696, 0.003039059927687049, -0.0010742646409198642, -0.01157358754426241, -0.0006178262992762029, 0.003045680932700634, 0.02080332487821579, 0.011282261461019516, 0.037686992436647415, -0.015996446833014488, 0.027146287262439728, 0.0024001291021704674, 0.0009335674112662673, 0.01240121852606535, 0.013043459504842758, 0.02300151251256466, 0.034826699644327164, 0.007627444341778755, -0.0038733116816729307, 0.005968872457742691, -0.014341184869408607, -0.004439411219209433, 0.026815233752131462, -0.0335024893283844, -0.041580166667699814, -0.0035257067065685987, -0.009057590737938881, 0.009011243470013142, -0.0267490241676569, -0.006713740061968565, 0.021637577563524246, 0.018035728484392166, 0.02725222334265709, -0.0031433412805199623, 0.0032939701341092587, -0.013586385175585747, -0.0010196410585194826, -0.023478228598833084, -0.005382909905165434, -0.027570033445954323, 0.012685922905802727, -0.00817699171602726, -0.0031582387164235115, -0.019373178482055664, 0.008488180115818977, 0.017823854461312294, -0.009838873520493507, 0.004644663538783789, 0.014672237448394299, 0.010937967337667942, -0.002706352388486266, 0.02294854447245598, -0.026669571176171303, 0.00148476951289922, 0.01010371558368206, -0.004260642919689417, 0.0024795816279947758, -0.005041926167905331, 0.0011570276692509651]]

・類似度検索

ベクトルストアから情報を検索する際に、以下の3つのメソッドがよく使われます:

・similarity_search


similarity_searchは、テキストクエリをベクトル化し、そのベクトルとベクトルストア内のドキュメントのベクトルとの類似度を計算します。一般的にはコサイン類似度が使われます。その結果、類似度の高い順に上位k個のドキュメントが返されます。
機能:指定したテキストクエリに最も類似したドキュメントを検索します。
返り値:類似したドキュメントのリスト(類似度スコアは含まれない

・similarity_search_with_score


similarity_search_with_scoreは、similarity_searchと同様にドキュメントを検索しますが、各ドキュメントに対する類似度スコアも一緒に返します。これにより、各ドキュメントがクエリにどの程度類似しているかを定量的に評価できます。
機能:指定したテキストクエリに最も類似したドキュメントと、その類似度スコアを取得します。
返り値:ドキュメントと類似度スコアのタプルのリスト。

・similarity_search_by_vector


similarity_search_by_vectorは、既にベクトル化されたクエリを使って検索を行います。これにより、カスタムのベクトルや複数のベクトルを一度に使って検索することが可能です。
機能:クエリテキストではなく、クエリベクトルを直接使って検索します。
返り値:類似したドキュメントのリスト(またはスコア付き)。

実際のcode

query = "桃"

・similarity_search

vectorstore.similarity_search(query,k=1)
[Document(metadata={'Header 1': '昔々', 'Header 2': '桃が流れてくる'}, page_content='## 桃が流れてくる\nおばあさんが川で洗濯をしていると、大きな桃がどんぶらこどんぶらこと流れてきました。')]

・similarity_search_with_score

vectorstore.similarity_search_with_score(query,k=1)
[(Document(metadata={'Header 1': '昔々', 'Header 2': '桃が流れてくる'}, page_content='## 桃が流れてくる\nおばあさんが川で洗濯をしていると、大きな桃がどんぶらこどんぶらこと流れてきました。'),
  0.3337773084640503)]

・similarity_search_by_vector

query_vector = embed.embed_query(query)
vectorstore.similarity_search_by_vector(query_vector, k=1)
[Document(metadata={'Header 1': '昔々', 'Header 2': '桃が流れてくる'}, page_content='## 桃が流れてくる\nおばあさんが川で洗濯をしていると、大きな桃がどんぶらこどんぶらこと流れてきました。')]


この記事が気に入ったらサポートをしてみませんか?