rcnn-sample-convergence-output

LAYER_1_NEURONS: 178
LAYER_2_NEURONS: 89
BATCH_SIZE: 10
LEARNING_RATE: 0.050000
GAMMA: 0.990000
IN_DIMENS: 89
OUT_DIMENS: 6
EXPLORATION_RATE: 0.100000
TRADE_EXPLORATION_RATE: 0.000000
TRADE_THRESHOLD: 0.500000
TRADE_FEE: 0.000000
TRADE_REWARD_PENALTY: 0.010000
DROPOUT_KEEP_PROB: 0.900000
NO_DISCOUNT: 0
AVG_REWARD_INCREMENT: 0
USE_Q_TABLE: 0
Q_TABLE_MULT: 0
EQUITY_BONUS_MULT: 10.000000
USE_DONE_REWARD: 0
LOW_TRADING_PENALTY: -0.010000
LOW_TRADING_THRESH: 40


Equity: 0.492280404821 at time step 1778
Iteration: 1

Equity: 0.50740021352 at time step 1778
Iteration: 2

Equity: 0.437619901015 at time step 1778
Iteration: 3

Equity: 0.521369505787 at time step 1778
Iteration: 4

Equity: 0.584097742129 at time step 1778
Iteration: 5

Equity: 0.5271749781 at time step 1778
Iteration: 6

Equity: 0.491761944845 at time step 1778
Iteration: 7

Equity: 0.452614228703 at time step 1778
Iteration: 8

Equity: 0.506847170534 at time step 1778
Iteration: 9


Average loss: 56.700951 in 9 episodes

Increasing batch size to 10
Have run 1 batch updates
Next update at 20

[]
Equity: 1.61355187181 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.72583773869906254, 0.03933237403101688, 0.032453444258355765, 0.00015413297137673298, 0.00893737356105943]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.95005100993357483, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.51620604879554621]
Min Gain or Loss: [0.8409600293507098, 0.44667826004124467, 0.74987310785474515, 0.13435355686106878]
Max Gain or Loss: [1.8069916926234744, 2.4319919248300352, 1.718046161624414, 1.3377467830458405]
Iteration: 10

Equity: 1.67247677489 at time step 1778
Iteration: 11

Equity: 1.68968590056 at time step 1778
Iteration: 12

Equity: 1.65800161241 at time step 1778
Iteration: 13

Equity: 1.61392179477 at time step 1778
Iteration: 14

Equity: 1.63407917091 at time step 1778
Iteration: 15

Equity: 1.67864691869 at time step 1778
Iteration: 16

Equity: 1.61894874578 at time step 1778
Iteration: 17

Equity: 1.67832709279 at time step 1778
Iteration: 18

Equity: 1.57355098531 at time step 1778
Iteration: 19


Average loss: -30.162810 in 10 episodes

Increasing batch size to 10
Have run 2 batch updates
Next update at 30

[]
Equity: 1.48576062846 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.71714451977655136, 0.020569414432318734, 0.021089390888321714, 0.034143893078885761, 0.013767845344794478]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.98646647171431767, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.51620604879554621]
Min Gain or Loss: [0.8409600293507098, 0.31936338744318993, 0.55329425426150569, 0.029375926661746352]
Max Gain or Loss: [2.6841750465311796, 2.922970822953137, 1.8953501364726331, 1.3377467830458405]
Iteration: 20

Equity: 1.70351212776 at time step 1778
Iteration: 21

Equity: 1.58997344199 at time step 1778
Iteration: 22

Equity: 1.3233024891 at time step 1778
Iteration: 23

Equity: 1.43709438589 at time step 1778
Iteration: 24

Equity: 1.53421544998 at time step 1778
Iteration: 25

Equity: 1.6040965806 at time step 1778
Iteration: 26

Equity: 1.65226518329 at time step 1778
Iteration: 27

Equity: 1.68351614284 at time step 1778
Iteration: 28

Equity: 1.66116406003 at time step 1778
Iteration: 29


Average loss: -386.150232 in 10 episodes

Increasing batch size to 10
Have run 3 batch updates
Next update at 40

[]
Equity: 1.74634551075 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.67859103719461744, 0.023717343831846815, 0.018099569773808031, 0.017973089263110406, 0.068334023457488055]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99231217655093984, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.51620604879554621]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6792631583544613e-05]
Max Gain or Loss: [37.94488874653095, 2.922970822953137, 1.8953501364726331, 1.3377467830458405]
Iteration: 30

Equity: 1.41666968912 at time step 1778
Iteration: 31

Equity: 1.40336541964 at time step 1778
Iteration: 32

Equity: 1.49806443014 at time step 1778
Iteration: 33

Equity: 1.57575352342 at time step 1778
Iteration: 34

Equity: 1.63261555671 at time step 1778
Iteration: 35

Equity: 1.67083889198 at time step 1778
Iteration: 36

Equity: 1.7175447966 at time step 1778
Iteration: 37

Equity: 1.77860269337 at time step 1778
Iteration: 38

Equity: 1.58445558511 at time step 1778
Iteration: 39


Average loss: -302.689578 in 10 episodes

Increasing batch size to 10
Have run 4 batch updates
Next update at 50

[]
Equity: 1.55422600997 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.65991969555122776, 0.027995878753660941, 0.023128291167792962, 0.012980258367617343, 0.082690939680572256]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99421718612725773, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.5202203107878336]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.922970822953137, 1.8953501364726331, 1.3377467830458405]
Iteration: 40

Equity: 1.33769946639 at time step 1778
Iteration: 41

Equity: 1.38843737453 at time step 1778
Iteration: 42

Equity: 1.48690309563 at time step 1778
Iteration: 43

Equity: 1.567170185 at time step 1778
Iteration: 44

Equity: 1.62655533289 at time step 1778
Iteration: 45

Equity: 1.66686390931 at time step 1778
Iteration: 46

Equity: 1.59025710628 at time step 1778
Iteration: 47

Equity: 1.6019274839 at time step 1778
Iteration: 48

Equity: 1.55986557992 at time step 1778
Iteration: 49


Average loss: -213.274821 in 10 episodes

Increasing batch size to 10
Have run 5 batch updates
Next update at 60

[]
Equity: 1.60687025411 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.6339960232095091, 0.01826967583321976, 0.017027162774643109, 0.019526855251708185, 0.11789534645179195]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99421718612725773, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.5202203107878336]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.922970822953137, 1.8953501364726331, 1.3377467830458405]
Iteration: 50

Equity: 1.35748275454 at time step 1778
Iteration: 51

Equity: 1.46788422195 at time step 1778
Iteration: 52

Equity: 1.55310871995 at time step 1778
Iteration: 53

Equity: 1.61664903514 at time step 1778
Iteration: 54

Equity: 1.66034408308 at time step 1778
Iteration: 55

Equity: 1.70140135774 at time step 1778
Iteration: 56

Equity: 1.58598989873 at time step 1778
Iteration: 57

Equity: 1.5083928175 at time step 1778
Iteration: 58

Equity: 1.36609045592 at time step 1778
Iteration: 59


Average loss: -297.320661 in 10 episodes

Increasing batch size to 10
Have run 6 batch updates
Next update at 70

[]
Equity: 1.47688683037 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.57934246378796495, 1.8163956298631806e-09, 0.0073136763243882652, 0.00073732689543150917, 0.21932159469669149]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99421718612725773, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.5202203107878336]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.3377467830458405]
Iteration: 60

Equity: 1.56040624908 at time step 1778
Iteration: 61

Equity: 1.62187940692 at time step 1778
Iteration: 62

Equity: 1.66380343022 at time step 1778
Iteration: 63

Equity: 1.67958408803 at time step 1778
Iteration: 64

Equity: 1.55361944136 at time step 1778
Iteration: 65

Equity: 1.35992806105 at time step 1778
Iteration: 66

Equity: 1.47526123103 at time step 1778
Iteration: 67

Equity: 1.55957607935 at time step 1778
Iteration: 68

Equity: 1.6213419415 at time step 1778
Iteration: 69


Average loss: -242.935341 in 10 episodes

Increasing batch size to 10
Have run 7 batch updates
Next update at 80

[]
Equity: 1.66345805977 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.74945232550140017, 4.0082438999788276e-19, 0.001149356385741384, 1.0540272599402844e-06, 0.056112327606471668]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99421718612725773, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.5202203107878336]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.3377467830458405]
Iteration: 70

Equity: 1.68821099142 at time step 1778
Iteration: 71

Equity: 1.54296239864 at time step 1778
Iteration: 72

Equity: 1.38704243744 at time step 1778
Iteration: 73

Equity: 1.48721361467 at time step 1778
Iteration: 74

Equity: 1.56870595421 at time step 1778
Iteration: 75

Equity: 1.62816993918 at time step 1778
Iteration: 76

Equity: 1.66810775086 at time step 1778
Iteration: 77

Equity: 1.56337575573 at time step 1778
Iteration: 78

Equity: 1.569779872 at time step 1778
Iteration: 79


Average loss: -522.881255 in 10 episodes

Increasing batch size to 10
Have run 8 batch updates
Next update at 90

[]
Equity: 1.39071170856 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.50044005709059036, 0.017305954875093642, 0.021073975489717279, 0.00046294610082224849, 0.26743212996464844]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99421718612725773, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.3409664826168315]
Iteration: 80

Equity: 1.46536248287 at time step 1778
Iteration: 81

Equity: 1.55305617321 at time step 1778
Iteration: 82

Equity: 1.61767875223 at time step 1778
Iteration: 83

Equity: 1.66143357429 at time step 1778
Iteration: 84

Equity: 1.54550871428 at time step 1778
Iteration: 85

Equity: 1.55193101328 at time step 1778
Iteration: 86

Equity: 1.75667434376 at time step 1778
Iteration: 87

Equity: 1.44479141295 at time step 1778
Iteration: 88

Equity: 1.55471990745 at time step 1778
Iteration: 89


Average loss: -294.523627 in 10 episodes

Increasing batch size to 10
Have run 9 batch updates
Next update at 100

[]
Equity: 1.37803638032 at time step 1778
Learning Rate: 0.05, Exploration Rate: 0.1
Avg Portfolio: [0.47996629311206324, 0.0027504462300414726, 0.003200474843947046, 5.2409617505036753e-06, 0.32079260837306928]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 90

Equity: 1.47639956199 at time step 1778
Iteration: 91

Equity: 1.55918477087 at time step 1778
Iteration: 92

Equity: 1.62108186894 at time step 1778
Iteration: 93

Equity: 1.66334331527 at time step 1778
Iteration: 94

Equity: 1.7320696794 at time step 1778
Iteration: 95

Equity: 1.5759789805 at time step 1778
Iteration: 96

Equity: 1.40663578125 at time step 1778
Iteration: 97

Equity: 1.43037378021 at time step 1778
Iteration: 98

Equity: 1.53039927504 at time step 1778
Iteration: 99


Average loss: -303.940890 in 10 episodes

Increasing batch size to 10
Have run 10 batch updates
Next update at 110

[]
Equity: 1.60238284543 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.69690958122321101, 0.0013793361029561934, 5.4605400811481878e-13, 2.5006654052206764e-05, 0.1084011395401045]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 100

Equity: 1.65154240231 at time step 1778
Iteration: 101

Equity: 1.6832100143 at time step 1778
Iteration: 102

Equity: 1.47195453402 at time step 1778
Iteration: 103

Equity: 1.42351595499 at time step 1778
Iteration: 104

Equity: 1.51673170895 at time step 1778
Iteration: 105

Equity: 1.58996073505 at time step 1778
Iteration: 106

Equity: 1.64237487651 at time step 1778
Iteration: 107

Equity: 1.78915837151 at time step 1778
Iteration: 108

Equity: 1.75952214435 at time step 1778
Iteration: 109


Average loss: -257.093579 in 10 episodes

Increasing batch size to 10
Have run 11 batch updates
Next update at 120

[]
Equity: 1.36412876757 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.46071541660779142, 0.017153743711200719, 0.0067506850246879082, 0.0032444780524406446, 0.31885074012474934]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 110

Equity: 1.45347766109 at time step 1778
Iteration: 111

Equity: 1.54218248911 at time step 1778
Iteration: 112

Equity: 1.60938696634 at time step 1778
Iteration: 113

Equity: 1.65577337097 at time step 1778
Iteration: 114

Equity: 1.65978256135 at time step 1778
Iteration: 115

Equity: 1.4467550654 at time step 1778
Iteration: 116

Equity: 1.43128750255 at time step 1778
Iteration: 117

Equity: 1.52398402576 at time step 1778
Iteration: 118

Equity: 1.59609333892 at time step 1778
Iteration: 119


Average loss: -253.722689 in 10 episodes

Increasing batch size to 10
Have run 12 batch updates
Next update at 130

[]
Equity: 1.64685754848 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.73522350991163277, 0.00021841108535697033, 0.0011391681686682242, 3.8938036912480395e-16, 0.070133974355212431]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.55329425426150569, 1.6465509010453096e-05]
Max Gain or Loss: [37.94488874653095, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 120

Equity: 1.54236506592 at time step 1778
Iteration: 121

Equity: 1.36818417328 at time step 1778
Iteration: 122

Equity: 1.4710367605 at time step 1778
Iteration: 123

Equity: 1.55632329282 at time step 1778
Iteration: 124

Equity: 1.61954951597 at time step 1778
Iteration: 125

Equity: 1.66250715187 at time step 1778
Iteration: 126

Equity: 1.5733465236 at time step 1778
Iteration: 127

Equity: 1.34204856544 at time step 1778
Iteration: 128

Equity: 1.44763884031 at time step 1778
Iteration: 129


Average loss: -615.090425 in 10 episodes

Increasing batch size to 10
Have run 13 batch updates
Next update at 140

[]
Equity: 1.53704359286 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.63586265483111171, 1.4608864554342373e-09, 0.0041903912422169391, 9.7329684506706324e-05, 0.16656468630214941]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.54409771021009123, 1.6059208079979144e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 130

Equity: 1.6050536048 at time step 1778
Iteration: 131

Equity: 1.65261870506 at time step 1778
Iteration: 132

Equity: 1.65025675268 at time step 1778
Iteration: 133

Equity: 1.68587229566 at time step 1778
Iteration: 134

Equity: 1.7389468108 at time step 1778
Iteration: 135

Equity: 1.53770744361 at time step 1778
Iteration: 136

Equity: 1.426637156 at time step 1778
Iteration: 137

Equity: 1.52250014312 at time step 1778
Iteration: 138

Equity: 1.59590179086 at time step 1778
Iteration: 139


Average loss: -252.750418 in 10 episodes

Increasing batch size to 10
Have run 14 batch updates
Next update at 150

[]
Equity: 1.64705174407 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.73543580489713156, 0.00044929394100005313, 0.0017840251389544758, 1.2308514605071646e-16, 0.069045939543785725]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52306094598698993]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.54409771021009123, 1.6059208079979144e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 140

Equity: 1.68032601858 at time step 1778
Iteration: 141

Equity: 1.49435736824 at time step 1778
Iteration: 142

Equity: 1.37537611438 at time step 1778
Iteration: 143

Equity: 1.48576126613 at time step 1778
Iteration: 144

Equity: 1.56895908683 at time step 1778
Iteration: 145

Equity: 1.62864443527 at time step 1778
Iteration: 146

Equity: 1.66850646874 at time step 1778
Iteration: 147

Equity: 1.63226322231 at time step 1778
Iteration: 148

Equity: 1.69148200027 at time step 1778
Iteration: 149


Average loss: -347.181692 in 10 episodes

Increasing batch size to 10
Have run 15 batch updates
Next update at 160

[]
Equity: 1.54105670402 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.71474109615724091, 0.025020191589077454, 0.0087842532569336745, 0.024338659181500018, 0.033830863336119212]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.54409771021009123, 1.6030209116139062e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 150

Equity: 1.33214578927 at time step 1778
Iteration: 151

Equity: 1.45581804665 at time step 1778
Iteration: 152

Equity: 1.54515717623 at time step 1778
Iteration: 153

Equity: 1.61193053927 at time step 1778
Iteration: 154

Equity: 1.65760158959 at time step 1778
Iteration: 155

Equity: 1.61583012168 at time step 1778
Iteration: 156

Equity: 1.39750817677 at time step 1778
Iteration: 157

Equity: 1.42631981109 at time step 1778
Iteration: 158

Equity: 1.51901510111 at time step 1778
Iteration: 159


Average loss: -269.741092 in 10 episodes

Increasing batch size to 10
Have run 16 batch updates
Next update at 170

[]
Equity: 1.59167786228 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.6862439702087394, 6.333860996542114e-13, 0.0012112642183585197, 9.265104321753044e-06, 0.11925056398881966]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81332323164814591, 0.018509495561306197, 0.54409771021009123, 1.6030209116139062e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 160

Equity: 1.64355791754 at time step 1778
Iteration: 161

Equity: 1.67787677284 at time step 1778
Iteration: 162

Equity: 1.57459600697 at time step 1778
Iteration: 163

Equity: 1.35390492084 at time step 1778
Iteration: 164

Equity: 1.46674501066 at time step 1778
Iteration: 165

Equity: 1.55097399028 at time step 1778
Iteration: 166

Equity: 1.61498220237 at time step 1778
Iteration: 167

Equity: 1.6592220932 at time step 1778
Iteration: 168

Equity: 1.65616439629 at time step 1778
Iteration: 169


Average loss: -534.733997 in 10 episodes

Increasing batch size to 10
Have run 17 batch updates
Next update at 180

[]
Equity: 1.36015555202 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.49895218460288732, 0.0056198480404856359, 0.0048284239655580572, 0.0016461636808308944, 0.2956684432311083]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.6030209116139062e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 170

Equity: 1.46427079795 at time step 1778
Iteration: 171

Equity: 1.54934877408 at time step 1778
Iteration: 172

Equity: 1.61399043007 at time step 1778
Iteration: 173

Equity: 1.65863726991 at time step 1778
Iteration: 174

Equity: 1.59364863341 at time step 1778
Iteration: 175

Equity: 1.56716790006 at time step 1778
Iteration: 176

Equity: 1.39191237457 at time step 1778
Iteration: 177

Equity: 1.48825122586 at time step 1778
Iteration: 178

Equity: 1.56826297811 at time step 1778
Iteration: 179


Average loss: -257.091591 in 10 episodes

Increasing batch size to 10
Have run 18 batch updates
Next update at 190

[]
Equity: 1.6274148986 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.71821222566970533, 7.9571770100079437e-05, 0.0005450768952056876, 4.3011513458898938e-16, 0.087878189185859434]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.6030209116139062e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 180

Equity: 1.66746649994 at time step 1778
Iteration: 181

Equity: 1.58331360377 at time step 1778
Iteration: 182

Equity: 1.36464372434 at time step 1778
Iteration: 183

Equity: 1.47226546589 at time step 1778
Iteration: 184

Equity: 1.55636700572 at time step 1778
Iteration: 185

Equity: 1.61896058982 at time step 1778
Iteration: 186

Equity: 1.66187359641 at time step 1778
Iteration: 187

Equity: 1.71963370421 at time step 1778
Iteration: 188

Equity: 1.38073003172 at time step 1778
Iteration: 189


Average loss: -579.342719 in 10 episodes

Increasing batch size to 10
Have run 19 batch updates
Next update at 200

[]
Equity: 1.45176538798 at time step 1778
Learning Rate: 0.0485, Exploration Rate: 0.097
Avg Portfolio: [0.55770732227546793, 0.0070651767386329632, 0.0082893935306114479, 8.4504455841203888e-07, 0.23365232593160012]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5286241686204604e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 190

Equity: 1.5424305882 at time step 1778
Iteration: 191

Equity: 1.61017471669 at time step 1778
Iteration: 192

Equity: 1.65651288362 at time step 1778
Iteration: 193

Equity: 1.65893176822 at time step 1778
Iteration: 194

Equity: 1.71585701242 at time step 1778
Iteration: 195

Equity: 1.41548363222 at time step 1778
Iteration: 196

Equity: 1.40971953017 at time step 1778
Iteration: 197

Equity: 1.50875905063 at time step 1778
Iteration: 198

Equity: 1.58436209945 at time step 1778
Iteration: 199


Average loss: -278.744507 in 10 episodes

Increasing batch size to 10
Have run 20 batch updates
Next update at 210

[]
Equity: 1.63857792804 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.72787130483199758, 3.374798216439454e-16, 0.0012012043521728558, 3.3590520729357939e-06, 0.077639195284626802]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5286241686204604e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 200

Equity: 1.67467848031 at time step 1778
Iteration: 201

Equity: 1.43250262932 at time step 1778
Iteration: 202

Equity: 1.40632808744 at time step 1778
Iteration: 203

Equity: 1.50779934663 at time step 1778
Iteration: 204

Equity: 1.58385472056 at time step 1778
Iteration: 205

Equity: 1.6382554958 at time step 1778
Iteration: 206

Equity: 1.67447620449 at time step 1778
Iteration: 207

Equity: 1.83248576756 at time step 1778
Iteration: 208

Equity: 1.61536569342 at time step 1778
Iteration: 209


Average loss: -541.139293 in 10 episodes

Increasing batch size to 10
Have run 21 batch updates
Next update at 220

[]
Equity: 1.2789211417 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.48534736194526779, 0.016248378592431553, 0.00088303789629969195, 0.013127195949395324, 0.29110908913747707]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5286241686204604e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 210

Equity: 1.45595957086 at time step 1778
Iteration: 211

Equity: 1.54802842931 at time step 1778
Iteration: 212

Equity: 1.61426371481 at time step 1778
Iteration: 213

Equity: 1.65917385691 at time step 1778
Iteration: 214

Equity: 1.70152177082 at time step 1778
Iteration: 215

Equity: 1.48756777323 at time step 1778
Iteration: 216

Equity: 1.39537858633 at time step 1778
Iteration: 217

Equity: 1.49573581089 at time step 1778
Iteration: 218

Equity: 1.57431907168 at time step 1778
Iteration: 219


Average loss: -277.247692 in 10 episodes

Increasing batch size to 10
Have run 22 batch updates
Next update at 230

[]
Equity: 1.63159335217 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.72144747664398012, 1.970076387884442e-16, 0.0033082404903452193, 3.1848447206127402e-06, 0.081956161541824807]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5286241686204604e-05]
Max Gain or Loss: [42.969890666607292, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 220

Equity: 1.67014870489 at time step 1778
Iteration: 221

Equity: 1.46590777448 at time step 1778
Iteration: 222

Equity: 1.38495500872 at time step 1778
Iteration: 223

Equity: 1.48613291987 at time step 1778
Iteration: 224

Equity: 1.56705369538 at time step 1778
Iteration: 225

Equity: 1.62660999974 at time step 1778
Iteration: 226

Equity: 1.66694562899 at time step 1778
Iteration: 227

Equity: 1.62097498696 at time step 1778
Iteration: 228

Equity: 1.56063176816 at time step 1778
Iteration: 229


Average loss: -664.218259 in 10 episodes

Increasing batch size to 10
Have run 23 batch updates
Next update at 240

[]
Equity: 1.50682147443 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.58321961522877896, 0.0080015170410715434, 0.012833049555457323, 0.0075033991137233606, 0.19515748258183971]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5100932085557592e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 230

Equity: 1.38224074366 at time step 1778
Iteration: 231

Equity: 1.48762297938 at time step 1778
Iteration: 232

Equity: 1.5700493255 at time step 1778
Iteration: 233

Equity: 1.62941250829 at time step 1778
Iteration: 234

Equity: 1.66902154323 at time step 1778
Iteration: 235

Equity: 1.65117595803 at time step 1778
Iteration: 236

Equity: 1.49626943203 at time step 1778
Iteration: 237

Equity: 1.40406523707 at time step 1778
Iteration: 238

Equity: 1.50253981622 at time step 1778
Iteration: 239


Average loss: -321.188551 in 10 episodes

Increasing batch size to 10
Have run 24 batch updates
Next update at 250

[]
Equity: 1.58064710548 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.67662774731529174, 0.0011800995233054079, 0.0038303153438880352, 4.975639760046442e-13, 0.12507690133788776]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 240

Equity: 1.6365337366 at time step 1778
Iteration: 241

Equity: 1.67355422442 at time step 1778
Iteration: 242

Equity: 1.47510710857 at time step 1778
Iteration: 243

Equity: 1.43947759828 at time step 1778
Iteration: 244

Equity: 1.52926195778 at time step 1778
Iteration: 245

Equity: 1.59920504714 at time step 1778
Iteration: 246

Equity: 1.64865462968 at time step 1778
Iteration: 247

Equity: 1.68112378519 at time step 1778
Iteration: 248

Equity: 1.37998378177 at time step 1778
Iteration: 249


Average loss: -381.292715 in 10 episodes

Increasing batch size to 10
Have run 25 batch updates
Next update at 260

[]
Equity: 1.43215266658 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.53725066126221999, 0.000775378523630958, 2.7830595635256636e-06, 0.0012077822761264571, 0.2674784583993296]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.54409771021009123, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 250

Equity: 1.52517526669 at time step 1778
Iteration: 251

Equity: 1.59652369843 at time step 1778
Iteration: 252

Equity: 1.64692579634 at time step 1778
Iteration: 253

Equity: 1.68005266419 at time step 1778
Iteration: 254

Equity: 1.70928971797 at time step 1778
Iteration: 255

Equity: 1.32591644277 at time step 1778
Iteration: 256

Equity: 1.43508732424 at time step 1778
Iteration: 257

Equity: 1.52916981424 at time step 1778
Iteration: 258

Equity: 1.59951172234 at time step 1778
Iteration: 259


Average loss: -266.984962 in 10 episodes

Increasing batch size to 10
Have run 26 batch updates
Next update at 270

[]
Equity: 1.64889697202 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.73642312622950701, 3.2734910487122176e-16, 0.0041671282537589513, 2.5379672657692053e-06, 0.066122271070337219]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52719076973429613]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.5267361328793605, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 260

Equity: 1.76050605945 at time step 1778
Iteration: 261

Equity: 1.43798937118 at time step 1778
Iteration: 262

Equity: 1.44223225757 at time step 1778
Iteration: 263

Equity: 1.53514023935 at time step 1778
Iteration: 264

Equity: 1.60507132481 at time step 1778
Iteration: 265

Equity: 1.65317694702 at time step 1778
Iteration: 266

Equity: 1.74482213455 at time step 1778
Iteration: 267

Equity: 1.68228812945 at time step 1778
Iteration: 268

Equity: 1.50461373197 at time step 1778
Iteration: 269


Average loss: -490.517294 in 10 episodes

Increasing batch size to 10
Have run 27 batch updates
Next update at 280

[]
Equity: 1.7019270175 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.69416371593767323, 0.024206466413318469, 0.013077932991925978, 0.011810167957045942, 0.063456780220905964]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.5267361328793605, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 270

Equity: 1.60548917842 at time step 1778
Iteration: 271

Equity: 1.57246277709 at time step 1778
Iteration: 272

Equity: 1.37934285766 at time step 1778
Iteration: 273

Equity: 1.481068766 at time step 1778
Iteration: 274

Equity: 1.56284060641 at time step 1778
Iteration: 275

Equity: 1.62351837836 at time step 1778
Iteration: 276

Equity: 1.66487319822 at time step 1778
Iteration: 277

Equity: 1.65434764635 at time step 1778
Iteration: 278

Equity: 1.41781271715 at time step 1778
Iteration: 279


Average loss: -316.432050 in 10 episodes

Increasing batch size to 10
Have run 28 batch updates
Next update at 290

[]
Equity: 1.45278811444 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.55515477496455612, 1.0084181379576074e-06, 0.0084039038950472975, 0.00056382665947779032, 0.24259154958365306]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.018509495561306197, 0.5267361328793605, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 280

Equity: 1.54062983971 at time step 1778
Iteration: 281

Equity: 1.60760243599 at time step 1778
Iteration: 282

Equity: 1.65431894407 at time step 1778
Iteration: 283

Equity: 1.68472330245 at time step 1778
Iteration: 284

Equity: 1.45648008154 at time step 1778
Iteration: 285

Equity: 1.45965502127 at time step 1778
Iteration: 286

Equity: 1.54707597381 at time step 1778
Iteration: 287

Equity: 1.61237729293 at time step 1778
Iteration: 288

Equity: 1.65752063751 at time step 1778
Iteration: 289


Average loss: -68.904111 in 10 episodes

Increasing batch size to 10
Have run 29 batch updates
Next update at 300

[]
Equity: 1.64519568657 at time step 1778
Learning Rate: 0.047045, Exploration Rate: 0.09409
Avg Portfolio: [0.73957764656456848, 0.0028834805123642664, 0.0040723907412142596, 0.003714945242729297, 0.056466600459994347]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.018502242019605077, 0.5267361328793605, 1.5067263219907142e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 290

Equity: 1.6977229797 at time step 1778
Iteration: 291

Equity: 1.4975390614 at time step 1778
Iteration: 292

Equity: 1.43843299824 at time step 1778
Iteration: 293

Equity: 1.53137954569 at time step 1778
Iteration: 294

Equity: 1.60109182261 at time step 1778
Iteration: 295

Equity: 1.64996607657 at time step 1778
Iteration: 296

Equity: 1.68196390908 at time step 1778
Iteration: 297

Equity: 1.47632019029 at time step 1778
Iteration: 298

Equity: 1.33499013167 at time step 1778
Iteration: 299


Average loss: -535.073891 in 10 episodes

Increasing batch size to 10
Have run 30 batch updates
Next update at 310

[]
Equity: 1.46723322765 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.57232769617407986, 2.943461317327696e-09, 0.0066380406055571127, 0.0018701059985608544, 0.22587921779921222]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.018502242019605077, 0.5267361328793605, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 300

Equity: 1.55489833127 at time step 1778
Iteration: 301

Equity: 1.61818065472 at time step 1778
Iteration: 302

Equity: 1.6613874712 at time step 1778
Iteration: 303

Equity: 1.66001163594 at time step 1778
Iteration: 304

Equity: 1.34783920452 at time step 1778
Iteration: 305

Equity: 1.46389329048 at time step 1778
Iteration: 306

Equity: 1.55157435002 at time step 1778
Iteration: 307

Equity: 1.61642068456 at time step 1778
Iteration: 308

Equity: 1.66053109518 at time step 1778
Iteration: 309


Average loss: -270.698215 in 10 episodes

Increasing batch size to 10
Have run 31 batch updates
Next update at 320

[]
Equity: 1.68562457055 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.72905436554621283, 0.0042249195287672771, 0.0044021618079179009, 0.0027607444627169579, 0.066272872175256459]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.018502242019605077, 0.5267361328793605, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 310

Equity: 1.69313987153 at time step 1778
Iteration: 311

Equity: 1.82999005931 at time step 1778
Iteration: 312

Equity: 1.58309348209 at time step 1778
Iteration: 313

Equity: 1.40215935586 at time step 1778
Iteration: 314

Equity: 1.4485820834 at time step 1778
Iteration: 315

Equity: 1.54067325326 at time step 1778
Iteration: 316

Equity: 1.60799480324 at time step 1778
Iteration: 317

Equity: 1.65461329637 at time step 1778
Iteration: 318

Equity: 1.68490967561 at time step 1778
Iteration: 319


Average loss: -269.619697 in 10 episodes

Increasing batch size to 10
Have run 32 batch updates
Next update at 330

[]
Equity: 1.42468303343 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.57071918511798903, 0.011989410248131833, 0.010753594170662613, 0.015773240968914647, 0.19747963301517268]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 320

Equity: 1.41793872012 at time step 1778
Iteration: 321

Equity: 1.51732995202 at time step 1778
Iteration: 322

Equity: 1.59097637942 at time step 1778
Iteration: 323

Equity: 1.64312199033 at time step 1778
Iteration: 324

Equity: 1.67759317056 at time step 1778
Iteration: 325

Equity: 1.56377069829 at time step 1778
Iteration: 326

Equity: 1.37914068835 at time step 1778
Iteration: 327

Equity: 1.48743700104 at time step 1778
Iteration: 328

Equity: 1.57033304082 at time step 1778
Iteration: 329


Average loss: -326.168896 in 10 episodes

Increasing batch size to 10
Have run 33 batch updates
Next update at 340

[]
Equity: 1.62970747639 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.72064781225212371, 0.00063037728058873096, 2.9769333045351071e-16, 3.1052988244269094e-06, 0.085433768689334971]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 330

Equity: 1.66924126303 at time step 1778
Iteration: 331

Equity: 1.76126759503 at time step 1778
Iteration: 332

Equity: 1.61688721062 at time step 1778
Iteration: 333

Equity: 1.89278558025 at time step 1778
Iteration: 334

Equity: 1.41718562587 at time step 1778
Iteration: 335

Equity: 1.45170185399 at time step 1778
Iteration: 336

Equity: 1.54140202471 at time step 1778
Iteration: 337

Equity: 1.60834910608 at time step 1778
Iteration: 338

Equity: 1.65484298762 at time step 1778
Iteration: 339


Average loss: -276.768480 in 10 episodes

Increasing batch size to 10
Have run 34 batch updates
Next update at 350

[]
Equity: 1.66283954824 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.71043606992322073, 0.0013463957031897126, 0.0025288401263494488, 0.0011526333058933837, 0.091251124462219099]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 340

Equity: 1.34763411951 at time step 1778
Iteration: 341

Equity: 1.45319869756 at time step 1778
Iteration: 342

Equity: 1.54187535758 at time step 1778
Iteration: 343

Equity: 1.60913078006 at time step 1778
Iteration: 344

Equity: 1.65558826864 at time step 1778
Iteration: 345

Equity: 1.55682795865 at time step 1778
Iteration: 346

Equity: 1.39135828804 at time step 1778
Iteration: 347

Equity: 1.48878982475 at time step 1778
Iteration: 348

Equity: 1.56906152044 at time step 1778
Iteration: 349


Average loss: -452.316312 in 10 episodes

Increasing batch size to 10
Have run 35 batch updates
Next update at 360

[]
Equity: 1.62810276219 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.71820131651078711, 0.00018584182848411723, 0.0052986673783244256, 2.4694526459429193e-18, 0.083029237803276035]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.52912108845465855]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [44.399403986932249, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 350

Equity: 1.66795335449 at time step 1778
Iteration: 351

Equity: 1.7479413154 at time step 1778
Iteration: 352

Equity: 1.47047110338 at time step 1778
Iteration: 353

Equity: 1.44694396022 at time step 1778
Iteration: 354

Equity: 1.53687429331 at time step 1778
Iteration: 355

Equity: 1.60497691777 at time step 1778
Iteration: 356

Equity: 1.65257488478 at time step 1778
Iteration: 357

Equity: 1.68362390327 at time step 1778
Iteration: 358

Equity: 1.43224561506 at time step 1778
Iteration: 359


Average loss: -570.657828 in 10 episodes

Increasing batch size to 10
Have run 36 batch updates
Next update at 370

[]
Equity: 1.38395699266 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.49101187441406297, 3.6017971595089765e-06, 0.0050509785182257351, 0.0032598598186427967, 0.30738874897278023]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 360

Equity: 1.48682777975 at time step 1778
Iteration: 361

Equity: 1.56754536339 at time step 1778
Iteration: 362

Equity: 1.62686626068 at time step 1778
Iteration: 363

Equity: 1.66707299895 at time step 1778
Iteration: 364

Equity: 1.65763128029 at time step 1778
Iteration: 365

Equity: 1.69935358581 at time step 1778
Iteration: 366

Equity: 1.3781857755 at time step 1778
Iteration: 367

Equity: 1.47586426215 at time step 1778
Iteration: 368

Equity: 1.55828239629 at time step 1778
Iteration: 369


Average loss: -272.573492 in 10 episodes

Increasing batch size to 10
Have run 37 batch updates
Next update at 380

[]
Equity: 1.62024410168 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.71190640987920628, 7.3582337076526803e-16, 3.9004839856864015e-05, 5.0429848872672621e-07, 0.094769144503318942]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 370

Equity: 1.66272183562 at time step 1778
Iteration: 371

Equity: 1.63719972414 at time step 1778
Iteration: 372

Equity: 1.38938280542 at time step 1778
Iteration: 373

Equity: 1.42781637947 at time step 1778
Iteration: 374

Equity: 1.52285916805 at time step 1778
Iteration: 375

Equity: 1.59593594239 at time step 1778
Iteration: 376

Equity: 1.64699569838 at time step 1778
Iteration: 377

Equity: 1.68026536434 at time step 1778
Iteration: 378

Equity: 1.62528177655 at time step 1778
Iteration: 379


Average loss: -615.411039 in 10 episodes

Increasing batch size to 10
Have run 38 batch updates
Next update at 390

[]
Equity: 1.71192041214 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.55830905652926122, 0.017020863982119615, 0.013998806081489082, 0.007066663148758057, 0.21031967377924354]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 380

Equity: 1.36098153599 at time step 1778
Iteration: 381

Equity: 1.46797714116 at time step 1778
Iteration: 382

Equity: 1.55528611835 at time step 1778
Iteration: 383

Equity: 1.61932812577 at time step 1778
Iteration: 384

Equity: 1.66254543333 at time step 1778
Iteration: 385

Equity: 1.73251883228 at time step 1778
Iteration: 386

Equity: 1.44451366904 at time step 1778
Iteration: 387

Equity: 1.45315615239 at time step 1778
Iteration: 388

Equity: 1.54497049811 at time step 1778
Iteration: 389


Average loss: -292.339404 in 10 episodes

Increasing batch size to 10
Have run 39 batch updates
Next update at 400

[]
Equity: 1.61119493802 at time step 1778
Learning Rate: 0.04563365, Exploration Rate: 0.0912673
Avg Portfolio: [0.70383689700449081, 1.980002886000598e-13, 0.00072540805978963307, 2.9409049045589485e-05, 0.10212334940734825]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 390

Equity: 1.65677154957 at time step 1778
Iteration: 391

Equity: 1.83880593863 at time step 1778
Iteration: 392

Equity: 1.71442911373 at time step 1778
Iteration: 393

Equity: 1.32420960916 at time step 1778
Iteration: 394

Equity: 1.43156171213 at time step 1778
Iteration: 395

Equity: 1.52720616507 at time step 1778
Iteration: 396

Equity: 1.5990255919 at time step 1778
Iteration: 397

Equity: 1.64898011781 at time step 1778
Iteration: 398

Equity: 1.68148591839 at time step 1778
Iteration: 399


Average loss: -261.822077 in 10 episodes

Increasing batch size to 10
Have run 40 batch updates
Next update at 410

[]
Equity: 1.49060995702 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.59803400745765101, 0.0031137096130641169, 0.0075649658992367162, 0.0083818462018604815, 0.18962053434905854]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 400

Equity: 1.39488209899 at time step 1778
Iteration: 401

Equity: 1.49495035958 at time step 1778
Iteration: 402

Equity: 1.57368888007 at time step 1778
Iteration: 403

Equity: 1.63116024137 at time step 1778
Iteration: 404

Equity: 1.66987354478 at time step 1778
Iteration: 405

Equity: 1.41178476336 at time step 1778
Iteration: 406

Equity: 1.44579109 at time step 1778
Iteration: 407

Equity: 1.53486199904 at time step 1778
Iteration: 408

Equity: 1.60367091838 at time step 1778
Iteration: 409


Average loss: -477.314676 in 10 episodes

Increasing batch size to 10
Have run 41 batch updates
Next update at 420

[]
Equity: 1.65181196002 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.73934426407338982, 0.00010059275066665917, 0.0018804652866440895, 1.4126583215972592e-17, 0.065389741410171204]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.9959916772007531, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 410

Equity: 1.68318412026 at time step 1778
Iteration: 411

Equity: 1.52947456528 at time step 1778
Iteration: 412

Equity: 1.90512096006 at time step 1778
Iteration: 413

Equity: 1.57889626825 at time step 1778
Iteration: 414

Equity: 1.35810972872 at time step 1778
Iteration: 415

Equity: 1.46055599214 at time step 1778
Iteration: 416

Equity: 1.54589489859 at time step 1778
Iteration: 417

Equity: 1.61132655128 at time step 1778
Iteration: 418

Equity: 1.65680358083 at time step 1778
Iteration: 419


Average loss: -341.201327 in 10 episodes

Increasing batch size to 10
Have run 42 batch updates
Next update at 430

[]
Equity: 1.68629595115 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.76906139728272982, 9.7404795619826665e-22, 0.00049198809075465971, 3.1433931490767271e-10, 0.037161677833047267]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 420

Equity: 1.6207451429 at time step 1778
Iteration: 421

Equity: 1.72791947573 at time step 1778
Iteration: 422

Equity: 1.3863284808 at time step 1778
Iteration: 423

Equity: 1.43994980517 at time step 1778
Iteration: 424

Equity: 1.53302676896 at time step 1778
Iteration: 425

Equity: 1.60234218423 at time step 1778
Iteration: 426

Equity: 1.65081089639 at time step 1778
Iteration: 427

Equity: 1.68249945011 at time step 1778
Iteration: 428

Equity: 1.3705156354 at time step 1778
Iteration: 429


Average loss: -276.646787 in 10 episodes

Increasing batch size to 10
Have run 43 batch updates
Next update at 440

[]
Equity: 1.44221539995 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.54426801691912785, 1.3749033271668139e-06, 0.012555246545251883, 0.00060453534757823129, 0.24928588980558669]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 430

Equity: 1.53196903664 at time step 1778
Iteration: 431

Equity: 1.6012504397 at time step 1778
Iteration: 432

Equity: 1.65004218425 at time step 1778
Iteration: 433

Equity: 1.68212745382 at time step 1778
Iteration: 434

Equity: 1.57014251055 at time step 1778
Iteration: 435

Equity: 1.48851052161 at time step 1778
Iteration: 436

Equity: 1.43051042945 at time step 1778
Iteration: 437

Equity: 1.52780693799 at time step 1778
Iteration: 438

Equity: 1.59931402698 at time step 1778
Iteration: 439


Average loss: -242.189140 in 10 episodes

Increasing batch size to 10
Have run 44 batch updates
Next update at 450

[]
Equity: 1.6490475216 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.73727831795779375, 0.00018155273150396439, 1.4919408242963318e-16, 2.830907563550653e-06, 0.069252361924008424]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.51401935018371836, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.4376745428643238]
Iteration: 440

Equity: 1.6814777363 at time step 1778
Iteration: 441

Equity: 1.33808983423 at time step 1778
Iteration: 442

Equity: 1.44566867552 at time step 1778
Iteration: 443

Equity: 1.53995626926 at time step 1778
Iteration: 444

Equity: 1.60809672608 at time step 1778
Iteration: 445

Equity: 1.65490857943 at time step 1778
Iteration: 446

Equity: 1.63155075995 at time step 1778
Iteration: 447

Equity: 1.36321669818 at time step 1778
Iteration: 448

Equity: 1.47006941417 at time step 1778
Iteration: 449


Average loss: -554.221902 in 10 episodes

Increasing batch size to 10
Have run 45 batch updates
Next update at 460

[]
Equity: 1.55695695348 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.65540147869068666, 0.0024625868843293286, 0.0066803543760313522, 2.7874113353044751e-13, 0.14217064356954448]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 450

Equity: 1.62051510295 at time step 1778
Iteration: 451

Equity: 1.66332341564 at time step 1778
Iteration: 452

Equity: 1.51417396043 at time step 1778
Iteration: 453

Equity: 1.39598543046 at time step 1778
Iteration: 454

Equity: 1.49406177404 at time step 1778
Iteration: 455

Equity: 1.5727932924 at time step 1778
Iteration: 456

Equity: 1.63050967339 at time step 1778
Iteration: 457

Equity: 1.66944590532 at time step 1778
Iteration: 458

Equity: 1.52776120816 at time step 1778
Iteration: 459


Average loss: -514.190823 in 10 episodes

Increasing batch size to 10
Have run 46 batch updates
Next update at 470

[]
Equity: 1.39251593457 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.49544557387031657, 0.0012351918637397842, 6.2725475936189209e-07, 0.00050855579218407674, 0.30952511473987193]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 460

Equity: 1.4896679262 at time step 1778
Iteration: 461

Equity: 1.56942810831 at time step 1778
Iteration: 462

Equity: 1.62822823548 at time step 1778
Iteration: 463

Equity: 1.66799360454 at time step 1778
Iteration: 464

Equity: 1.36686490969 at time step 1778
Iteration: 465

Equity: 1.43967680357 at time step 1778
Iteration: 466

Equity: 1.53030287973 at time step 1778
Iteration: 467

Equity: 1.60028214523 at time step 1778
Iteration: 468

Equity: 1.64949691427 at time step 1778
Iteration: 469


Average loss: -228.560959 in 10 episodes

Increasing batch size to 10
Have run 47 batch updates
Next update at 480

[]
Equity: 1.68170350837 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.7652496837336713, 2.2820782859609781e-05, 4.5193489561619196e-20, 4.9527281498705852e-08, 0.041442509477057507]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.4352073043062193e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 470

Equity: 1.59987476163 at time step 1778
Iteration: 471

Equity: 1.36698450012 at time step 1778
Iteration: 472

Equity: 1.46953464574 at time step 1778
Iteration: 473

Equity: 1.55495997151 at time step 1778
Iteration: 474

Equity: 1.61850914612 at time step 1778
Iteration: 475

Equity: 1.66179291191 at time step 1778
Iteration: 476

Equity: 1.46663992871 at time step 1778
Iteration: 477

Equity: 1.41087661525 at time step 1778
Iteration: 478

Equity: 1.50547691525 at time step 1778
Iteration: 479


Average loss: -844.551028 in 10 episodes

Increasing batch size to 10
Have run 48 batch updates
Next update at 490

[]
Equity: 1.58137865717 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.67614229187291663, 1.6176317840644131e-14, 0.0070566225908583998, 8.1204720476651016e-06, 0.12350802858503221]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.3630951944994965e-05]
Max Gain or Loss: [48.458459317629853, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 480

Equity: 1.63645340204 at time step 1778
Iteration: 481

Equity: 1.67329211313 at time step 1778
Iteration: 482

Equity: 1.66232301143 at time step 1778
Iteration: 483

Equity: 1.68751400518 at time step 1778
Iteration: 484

Equity: 1.33726946128 at time step 1778
Iteration: 485

Equity: 1.46616807446 at time step 1778
Iteration: 486

Equity: 1.55776716246 at time step 1778
Iteration: 487

Equity: 1.62211222408 at time step 1778
Iteration: 488

Equity: 1.66469462728 at time step 1778
Iteration: 489


Average loss: -900.912196 in 10 episodes

Increasing batch size to 10
Have run 49 batch updates
Next update at 500

[]
Equity: 1.69287469635 at time step 1778
Learning Rate: 0.0442646405, Exploration Rate: 0.088529281
Avg Portfolio: [0.72189515005990745, 0.0063289444269751128, 0.0053634985671357546, 0.001698724801756903, 0.0714287456650953]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 490

Equity: 1.41284465933 at time step 1778
Iteration: 491

Equity: 1.43649954139 at time step 1778
Iteration: 492

Equity: 1.52675464585 at time step 1778
Iteration: 493

Equity: 1.59754616532 at time step 1778
Iteration: 494

Equity: 1.64762399088 at time step 1778
Iteration: 495

Equity: 1.68050225126 at time step 1778
Iteration: 496

Equity: 1.46371153565 at time step 1778
Iteration: 497

Equity: 1.41024667242 at time step 1778
Iteration: 498

Equity: 1.50730842973 at time step 1778
Iteration: 499


Average loss: -524.044708 in 10 episodes

Increasing batch size to 10
Have run 50 batch updates
Next update at 510

[]
Equity: 1.5834410657 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.67920432399918351, 0.00038093368504922955, 6.2249679421108593e-13, 1.3560747175246067e-05, 0.12711624508884131]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 500

Equity: 1.63810247367 at time step 1778
Iteration: 501

Equity: 1.67443803374 at time step 1778
Iteration: 502

Equity: 1.68857461982 at time step 1778
Iteration: 503

Equity: 1.46297412037 at time step 1778
Iteration: 504

Equity: 1.36493034086 at time step 1778
Iteration: 505

Equity: 1.47181038676 at time step 1778
Iteration: 506

Equity: 1.55594465948 at time step 1778
Iteration: 507

Equity: 1.61866567789 at time step 1778
Iteration: 508

Equity: 1.66168761401 at time step 1778
Iteration: 509


Average loss: -312.027220 in 10 episodes

Increasing batch size to 10
Have run 51 batch updates
Next update at 520

[]
Equity: 1.82046125108 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.74922351719385005, 0.0054991866938147848, 0.0050318874404442614, 0.00088272736073625123, 0.046077744832024627]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 510

Equity: 1.37717375554 at time step 1778
Iteration: 511

Equity: 1.44062645466 at time step 1778
Iteration: 512

Equity: 1.5325161825 at time step 1778
Iteration: 513

Equity: 1.60266206829 at time step 1778
Iteration: 514

Equity: 1.6513840582 at time step 1778
Iteration: 515

Equity: 1.68299743499 at time step 1778
Iteration: 516

Equity: 1.39551827629 at time step 1778
Iteration: 517

Equity: 1.43628263007 at time step 1778
Iteration: 518

Equity: 1.5260049913 at time step 1778
Iteration: 519


Average loss: -556.765610 in 10 episodes

Increasing batch size to 10
Have run 52 batch updates
Next update at 530

[]
Equity: 1.59674249163 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.69068111958846534, 2.9199592696271051e-13, 0.0019765286912964701, 8.9049274443976588e-07, 0.11405652474807279]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 520

Equity: 1.64698992393 at time step 1778
Iteration: 521

Equity: 1.6941939575 at time step 1778
Iteration: 522

Equity: 1.78411944583 at time step 1778
Iteration: 523

Equity: 1.46382422308 at time step 1778
Iteration: 524

Equity: 1.40324331315 at time step 1778
Iteration: 525

Equity: 1.49917478628 at time step 1778
Iteration: 526

Equity: 1.5766027784 at time step 1778
Iteration: 527

Equity: 1.63315415739 at time step 1778
Iteration: 528

Equity: 1.67116338715 at time step 1778
Iteration: 529


Average loss: -243.832739 in 10 episodes

Increasing batch size to 10
Have run 53 batch updates
Next update at 540

[]
Equity: 1.66577215377 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.75307839584530456, 0.0019649178511480913, 0.013623764548032536, 0.0021417891645077185, 0.035906196111876697]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 530

Equity: 1.63391644707 at time step 1778
Iteration: 531

Equity: 1.39382732854 at time step 1778
Iteration: 532

Equity: 1.44595648851 at time step 1778
Iteration: 533

Equity: 1.53623321062 at time step 1778
Iteration: 534

Equity: 1.60481579638 at time step 1778
Iteration: 535

Equity: 1.65260233266 at time step 1778
Iteration: 536

Equity: 1.68369165188 at time step 1778
Iteration: 537

Equity: 1.57467346982 at time step 1778
Iteration: 538

Equity: 1.4073021729 at time step 1778
Iteration: 539


Average loss: -416.860218 in 10 episodes

Increasing batch size to 10
Have run 54 batch updates
Next update at 550

[]
Equity: 1.50417781234 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.60625706012374125, 0.0022994488811032567, 0.0024221387593286268, 2.6601794241155992e-09, 0.19573641309651807]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 540

Equity: 1.58145268613 at time step 1778
Iteration: 541

Equity: 1.6369332334 at time step 1778
Iteration: 542

Equity: 1.67375932122 at time step 1778
Iteration: 543

Equity: 1.80094301806 at time step 1778
Iteration: 544

Equity: 1.52326843581 at time step 1778
Iteration: 545

Equity: 1.43996968453 at time step 1778
Iteration: 546

Equity: 1.53049904433 at time step 1778
Iteration: 547

Equity: 1.6006400455 at time step 1778
Iteration: 548

Equity: 1.64983732899 at time step 1778
Iteration: 549


Average loss: -330.167690 in 10 episodes

Increasing batch size to 10
Have run 55 batch updates
Next update at 560

[]
Equity: 1.68195601008 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.76546226700213771, 4.9001327389931856e-05, 0.00011320435682665966, 1.0183500040036936e-19, 0.04109059083451639]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 550

Equity: 1.33412013497 at time step 1778
Iteration: 551

Equity: 1.40463124037 at time step 1778
Iteration: 552

Equity: 1.50360352321 at time step 1778
Iteration: 553

Equity: 1.58034869365 at time step 1778
Iteration: 554

Equity: 1.63579183042 at time step 1778
Iteration: 555

Equity: 1.67287592162 at time step 1778
Iteration: 556

Equity: 1.73397221714 at time step 1778
Iteration: 557

Equity: 1.49016843371 at time step 1778
Iteration: 558

Equity: 1.45234968958 at time step 1778
Iteration: 559


Average loss: -296.450066 in 10 episodes

Increasing batch size to 10
Have run 56 batch updates
Next update at 570

[]
Equity: 1.54275382396 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.64268465890114912, 0.0015836636777003914, 1.6118749684016968e-09, 7.627054642661366e-05, 0.16237046878371983]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 560

Equity: 1.61000054908 at time step 1778
Iteration: 561

Equity: 1.65622103696 at time step 1778
Iteration: 562

Equity: 1.70090797104 at time step 1778
Iteration: 563

Equity: 1.52876349226 at time step 1778
Iteration: 564

Equity: 1.28878405945 at time step 1778
Iteration: 565

Equity: 1.44213833451 at time step 1778
Iteration: 566

Equity: 1.53477777879 at time step 1778
Iteration: 567

Equity: 1.604702857 at time step 1778
Iteration: 568

Equity: 1.65289493828 at time step 1778
Iteration: 569


Average loss: -273.427287 in 10 episodes

Increasing batch size to 10
Have run 57 batch updates
Next update at 580

[]
Equity: 1.72513607909 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.76061824673453515, 0.00049450563067873852, 0.0045876330176460953, 0.00043459632980450319, 0.040580081808206422]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 570

Equity: 1.590646029 at time step 1778
Iteration: 571

Equity: 1.69102992087 at time step 1778
Iteration: 572

Equity: 1.66356673517 at time step 1778
Iteration: 573

Equity: 1.45933618817 at time step 1778
Iteration: 574

Equity: 1.40315278793 at time step 1778
Iteration: 575

Equity: 1.50045005486 at time step 1778
Iteration: 576

Equity: 1.57772745607 at time step 1778
Iteration: 577

Equity: 1.6339497607 at time step 1778
Iteration: 578

Equity: 1.67167968855 at time step 1778
Iteration: 579


Average loss: -260.946733 in 10 episodes

Increasing batch size to 10
Have run 58 batch updates
Next update at 590

[]
Equity: 1.68898280129 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.66465776778326591, 0.0035409185106886052, 0.0045139016609773448, 0.0077221368831578881, 0.1262803386827811]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 580

Equity: 1.58134602549 at time step 1778
Iteration: 581

Equity: 1.63046342517 at time step 1778
Iteration: 582

Equity: 1.6957246059 at time step 1778
Iteration: 583

Equity: 1.56545911077 at time step 1778
Iteration: 584

Equity: 1.43049754432 at time step 1778
Iteration: 585

Equity: 1.41829901565 at time step 1778
Iteration: 586

Equity: 1.51468210268 at time step 1778
Iteration: 587

Equity: 1.58869337402 at time step 1778
Iteration: 588

Equity: 1.64154574364 at time step 1778
Iteration: 589


Average loss: -344.109946 in 10 episodes

Increasing batch size to 10
Have run 59 batch updates
Next update at 600

[]
Equity: 1.67659048936 at time step 1778
Learning Rate: 0.042936701285, Exploration Rate: 0.08587340257
Avg Portfolio: [0.76087287388800917, 1.3641309152007647e-19, 4.3127371793364239e-05, 2.3800321400565622e-07, 0.045798824257854545]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 590

Equity: 1.64751286906 at time step 1778
Iteration: 591

Equity: 1.49562307619 at time step 1778
Iteration: 592

Equity: 1.64911292763 at time step 1778
Iteration: 593

Equity: 1.3947739409 at time step 1778
Iteration: 594

Equity: 1.43800218328 at time step 1778
Iteration: 595

Equity: 1.5302328748 at time step 1778
Iteration: 596

Equity: 1.6006707179 at time step 1778
Iteration: 597

Equity: 1.64991031224 at time step 1778
Iteration: 598

Equity: 1.6820178335 at time step 1778
Iteration: 599


Average loss: -322.859016 in 10 episodes

Increasing batch size to 10
Have run 60 batch updates
Next update at 610

[]
Equity: 1.3942544654 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.48758736595849039, 0.0052703569813669429, 0.0033937732329610017, 0.003637913441471938, 0.30682565390658212]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 600

Equity: 1.45233905835 at time step 1778
Iteration: 601

Equity: 1.53954522413 at time step 1778
Iteration: 602

Equity: 1.60680999859 at time step 1778
Iteration: 603

Equity: 1.65381828844 at time step 1778
Iteration: 604

Equity: 1.68442251011 at time step 1778
Iteration: 605

Equity: 1.61485125148 at time step 1778
Iteration: 606

Equity: 1.36940019202 at time step 1778
Iteration: 607

Equity: 1.47137564609 at time step 1778
Iteration: 608

Equity: 1.556295753 at time step 1778
Iteration: 609


Average loss: -444.818948 in 10 episodes

Increasing batch size to 10
Have run 61 batch updates
Next update at 620

[]
Equity: 1.61942393971 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.71107155836250768, 0.00044053747704154755, 0.0026960045328921589, 4.2629437721363379e-17, 0.092506963148429891]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 1.0148641778889379e-05]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 610

Equity: 1.66238903894 at time step 1778
Iteration: 611

Equity: 1.61835187936 at time step 1778
Iteration: 612

Equity: 1.68627905664 at time step 1778
Iteration: 613

Equity: 1.74484692803 at time step 1778
Iteration: 614

Equity: 1.56202182594 at time step 1778
Iteration: 615

Equity: 1.39412581707 at time step 1778
Iteration: 616

Equity: 1.49046544997 at time step 1778
Iteration: 617

Equity: 1.56979528828 at time step 1778
Iteration: 618

Equity: 1.62839191113 at time step 1778
Iteration: 619


Average loss: -333.505362 in 10 episodes

Increasing batch size to 10
Have run 62 batch updates
Next update at 630

[]
Equity: 1.66806671666 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.75353271133049993, 1.2858575826187874e-19, 0.00033944526002019799, 6.3484480790216884e-08, 0.052842843445870258]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 620

Equity: 1.58737233097 at time step 1778
Iteration: 621

Equity: 1.53845071461 at time step 1778
Iteration: 622

Equity: 1.5058848914 at time step 1778
Iteration: 623

Equity: 1.44179892963 at time step 1778
Iteration: 624

Equity: 1.53224777964 at time step 1778
Iteration: 625

Equity: 1.60154256386 at time step 1778
Iteration: 626

Equity: 1.65026098042 at time step 1778
Iteration: 627

Equity: 1.66086456532 at time step 1778
Iteration: 628

Equity: 1.36620881407 at time step 1778
Iteration: 629


Average loss: -542.620995 in 10 episodes

Increasing batch size to 10
Have run 63 batch updates
Next update at 640

[]
Equity: 1.47155660487 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.57407627792173543, 2.6216867828229354e-10, 0.0019409814412976391, 0.00042824252027871389, 0.23026956137539167]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 630

Equity: 1.55558170224 at time step 1778
Iteration: 631

Equity: 1.61838832168 at time step 1778
Iteration: 632

Equity: 1.66150186113 at time step 1778
Iteration: 633

Equity: 1.73373701288 at time step 1778
Iteration: 634

Equity: 1.30497986719 at time step 1778
Iteration: 635

Equity: 1.46273743309 at time step 1778
Iteration: 636

Equity: 1.54785379671 at time step 1778
Iteration: 637

Equity: 1.6127407664 at time step 1778
Iteration: 638

Equity: 1.65773104832 at time step 1778
Iteration: 639


Average loss: -300.032074 in 10 episodes

Increasing batch size to 10
Have run 64 batch updates
Next update at 650

[]
Equity: 1.6476196367 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.75997548861804876, 0.0011049324898708217, 0.0027769992170350133, 0.00095657712606702912, 0.041901066069849918]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 640

Equity: 1.43623876503 at time step 1778
Iteration: 641

Equity: 1.44345858919 at time step 1778
Iteration: 642

Equity: 1.5355544848 at time step 1778
Iteration: 643

Equity: 1.60515001049 at time step 1778
Iteration: 644

Equity: 1.65314926988 at time step 1778
Iteration: 645

Equity: 1.6841492066 at time step 1778
Iteration: 646

Equity: 1.44954600981 at time step 1778
Iteration: 647

Equity: 1.41096470427 at time step 1778
Iteration: 648

Equity: 1.51203122346 at time step 1778
Iteration: 649


Average loss: -583.483566 in 10 episodes

Increasing batch size to 10
Have run 65 batch updates
Next update at 660

[]
Equity: 1.58791458244 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.683562199404808, 0.00082952536363373706, 1.386738819408578e-13, 2.7829296928417228e-05, 0.12229550945536299]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 650

Equity: 1.64143269821 at time step 1778
Iteration: 651

Equity: 1.67666206745 at time step 1778
Iteration: 652

Equity: 1.67433317036 at time step 1778
Iteration: 653

Equity: 1.38074378032 at time step 1778
Iteration: 654

Equity: 1.46083903972 at time step 1778
Iteration: 655

Equity: 1.54808273587 at time step 1778
Iteration: 656

Equity: 1.61362724054 at time step 1778
Iteration: 657

Equity: 1.65858719283 at time step 1778
Iteration: 658

Equity: 1.68750517726 at time step 1778
Iteration: 659


Average loss: -377.363401 in 10 episodes

Increasing batch size to 10
Have run 66 batch updates
Next update at 670

[]
Equity: 1.63825263459 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.57723647538351675, 0.011293484924620749, 0.011658020135661119, 0.0031586207727964922, 0.20336846230427619]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 660

Equity: 1.39172007779 at time step 1778
Iteration: 661

Equity: 1.4882920533 at time step 1778
Iteration: 662

Equity: 1.56809606829 at time step 1778
Iteration: 663

Equity: 1.62719639984 at time step 1778
Iteration: 664

Equity: 1.66728546921 at time step 1778
Iteration: 665

Equity: 1.6582392844 at time step 1778
Iteration: 666

Equity: 1.35377870154 at time step 1778
Iteration: 667

Equity: 1.46096321198 at time step 1778
Iteration: 668

Equity: 1.54785975182 at time step 1778
Iteration: 669


Average loss: -487.020979 in 10 episodes

Increasing batch size to 10
Have run 67 batch updates
Next update at 680

[]
Equity: 1.61290909864 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.7049070666349454, 1.4012191306809156e-13, 0.0036810997597826545, 9.5116394019954405e-06, 0.09811738548660115]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 670

Equity: 1.65786765962 at time step 1778
Iteration: 671

Equity: 1.68696378323 at time step 1778
Iteration: 672

Equity: 1.3557081064 at time step 1778
Iteration: 673

Equity: 1.45631445367 at time step 1778
Iteration: 674

Equity: 1.54458901938 at time step 1778
Iteration: 675

Equity: 1.61116025156 at time step 1778
Iteration: 676

Equity: 1.65696164337 at time step 1778
Iteration: 677

Equity: 1.66036346794 at time step 1778
Iteration: 678

Equity: 1.35491532442 at time step 1778
Iteration: 679


Average loss: -391.362000 in 10 episodes

Increasing batch size to 10
Have run 68 batch updates
Next update at 690

[]
Equity: 1.43641640921 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.54069784194470694, 2.4708361070364031e-07, 0.010537774203844202, 0.0015662178137469274, 0.25391298247496269]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 680

Equity: 1.52902309834 at time step 1778
Iteration: 681

Equity: 1.59927837262 at time step 1778
Iteration: 682

Equity: 1.64873209036 at time step 1778
Iteration: 683

Equity: 1.68117737258 at time step 1778
Iteration: 684

Equity: 1.61272302873 at time step 1778
Iteration: 685

Equity: 1.61464476587 at time step 1778
Iteration: 686

Equity: 1.40841320221 at time step 1778
Iteration: 687

Equity: 1.44476402491 at time step 1778
Iteration: 688

Equity: 1.53593184445 at time step 1778
Iteration: 689


Average loss: -297.727278 in 10 episodes

Increasing batch size to 10
Have run 69 batch updates
Next update at 700

[]
Equity: 1.60494207191 at time step 1778
Learning Rate: 0.0416486002464, Exploration Rate: 0.0832972004929
Avg Portfolio: [0.69865247990913559, 0.000557014432871237, 1.243433452503028e-14, 5.0699951222812874e-06, 0.10750049918373042]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 690

Equity: 1.65281952096 at time step 1778
Iteration: 691

Equity: 1.68387568044 at time step 1778
Iteration: 692

Equity: 1.42824928784 at time step 1778
Iteration: 693

Equity: 1.42826198426 at time step 1778
Iteration: 694

Equity: 1.52325645357 at time step 1778
Iteration: 695

Equity: 1.59512785236 at time step 1778
Iteration: 696

Equity: 1.64593942384 at time step 1778
Iteration: 697

Equity: 1.67940432076 at time step 1778
Iteration: 698

Equity: 1.57815267538 at time step 1778
Iteration: 699


Average loss: -431.895401 in 10 episodes

Increasing batch size to 10
Have run 70 batch updates
Next update at 710

[]
Equity: 1.6121212067 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.65207974015974468, 0.018710469225665043, 0.016771438394389642, 0.01860464123085619, 0.10054877451021681]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 700

Equity: 1.75962288158 at time step 1778
Iteration: 701

Equity: 1.45691566462 at time step 1778
Iteration: 702

Equity: 1.45243726492 at time step 1778
Iteration: 703

Equity: 1.5421779982 at time step 1778
Iteration: 704

Equity: 1.60932154496 at time step 1778
Iteration: 705

Equity: 1.65567352163 at time step 1778
Iteration: 706

Equity: 1.68565164408 at time step 1778
Iteration: 707

Equity: 1.41572072196 at time step 1778
Iteration: 708

Equity: 1.40788830964 at time step 1778
Iteration: 709


Average loss: -322.979000 in 10 episodes

Increasing batch size to 10
Have run 71 batch updates
Next update at 720

[]
Equity: 1.5064125329 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.60713392424317025, 6.294514298919852e-10, 0.0052705636400018213, 0.00027497005296021936, 0.19403560495528788]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 710

Equity: 1.58248874564 at time step 1778
Iteration: 711

Equity: 1.63727161105 at time step 1778
Iteration: 712

Equity: 1.67383175569 at time step 1778
Iteration: 713

Equity: 1.6317654314 at time step 1778
Iteration: 714

Equity: 1.3309325913 at time step 1778
Iteration: 715

Equity: 1.46045087452 at time step 1778
Iteration: 716

Equity: 1.54892618961 at time step 1778
Iteration: 717

Equity: 1.614242918 at time step 1778
Iteration: 718

Equity: 1.6589592021 at time step 1778
Iteration: 719


Average loss: -329.267598 in 10 episodes

Increasing batch size to 10
Have run 72 batch updates
Next update at 730

[]
Equity: 1.73982059391 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.74341716861609219, 0.0026510140472119142, 0.001894191132652817, 0.003246554862033148, 0.055506134862880731]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 720

Equity: 1.67780371647 at time step 1778
Iteration: 721

Equity: 1.44731745811 at time step 1778
Iteration: 722

Equity: 1.43632242774 at time step 1778
Iteration: 723

Equity: 1.53084475885 at time step 1778
Iteration: 724

Equity: 1.60182877732 at time step 1778
Iteration: 725

Equity: 1.65093793121 at time step 1778
Iteration: 726

Equity: 1.68275498104 at time step 1778
Iteration: 727

Equity: 1.44712699787 at time step 1778
Iteration: 728

Equity: 1.46724511792 at time step 1778
Iteration: 729


Average loss: -476.497097 in 10 episodes

Increasing batch size to 10
Have run 73 batch updates
Next update at 740

[]
Equity: 1.55233549169 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.65052283578389014, 6.6887236928623091e-11, 0.00017413240676479634, 5.7566388255872037e-05, 0.155960528875073]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 730

Equity: 1.61608624561 at time step 1778
Iteration: 731

Equity: 1.65998250081 at time step 1778
Iteration: 732

Equity: 1.7709928245 at time step 1778
Iteration: 733

Equity: 1.31250435642 at time step 1778
Iteration: 734

Equity: 1.42643753633 at time step 1778
Iteration: 735

Equity: 1.5241822994 at time step 1778
Iteration: 736

Equity: 1.59706778606 at time step 1778
Iteration: 737

Equity: 1.64773619718 at time step 1778
Iteration: 738

Equity: 1.68072011223 at time step 1778
Iteration: 739


Average loss: -339.784610 in 10 episodes

Increasing batch size to 10
Have run 74 batch updates
Next update at 750

[]
Equity: 1.60729692959 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.68068072349249098, 0.0055054544621195222, 0.004404041129766105, 0.0078376182448062943, 0.10828722619168929]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 7.709487255928902e-06]
Max Gain or Loss: [91.105308700163121, 2.9504630563143004, 1.9884712123806014, 1.5053366190972788]
Iteration: 740

Equity: 1.51221166146 at time step 1778
Iteration: 741

Equity: 1.39767770011 at time step 1778
Iteration: 742

Equity: 1.49287788136 at time step 1778
Iteration: 743

Equity: 1.57158752957 at time step 1778
Iteration: 744

Equity: 1.62963833288 at time step 1778
Iteration: 745

Equity: 1.66887719827 at time step 1778
Iteration: 746

Equity: 1.63373772988 at time step 1778
Iteration: 747

Equity: 1.35990648923 at time step 1778
Iteration: 748

Equity: 1.47673106757 at time step 1778
Iteration: 749


Average loss: -627.683929 in 10 episodes

Increasing batch size to 10
Have run 75 batch updates
Next update at 760

[]
Equity: 1.56102529273 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.65874914596133671, 0.0001081803297898163, 1.2258765920160337e-13, 0.00011079586556234349, 0.14774694136405833]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 5.5001260829747177e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 750

Equity: 1.62244849637 at time step 1778
Iteration: 751

Equity: 1.66421250247 at time step 1778
Iteration: 752

Equity: 1.50465419836 at time step 1778
Iteration: 753

Equity: 1.37936487487 at time step 1778
Iteration: 754

Equity: 1.48633620963 at time step 1778
Iteration: 755

Equity: 1.5693920358 at time step 1778
Iteration: 756

Equity: 1.6290613827 at time step 1778
Iteration: 757

Equity: 1.66882954953 at time step 1778
Iteration: 758

Equity: 1.68539969938 at time step 1778
Iteration: 759


Average loss: -1177.745609 in 10 episodes

Increasing batch size to 10
Have run 76 batch updates
Next update at 770

[]
Equity: 1.54778593925 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.55363379602945395, 0.0080970954001424629, 0.013018772955091355, 0.015845588115417569, 0.21611981102076633]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 5.5001260829747177e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 760

Equity: 1.37605533103 at time step 1778
Iteration: 761

Equity: 1.47759918192 at time step 1778
Iteration: 762

Equity: 1.56004203276 at time step 1778
Iteration: 763

Equity: 1.62152342829 at time step 1778
Iteration: 764

Equity: 1.66355910138 at time step 1778
Iteration: 765

Equity: 1.53717128705 at time step 1778
Iteration: 766

Equity: 1.38033741317 at time step 1778
Iteration: 767

Equity: 1.48368215368 at time step 1778
Iteration: 768

Equity: 1.56571671117 at time step 1778
Iteration: 769


Average loss: -258.329224 in 10 episodes

Increasing batch size to 10
Have run 77 batch updates
Next update at 780

[]
Equity: 1.6258716398 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.71702156375072934, 0.00022090118653889833, 8.0026291186870117e-17, 2.7305227784298385e-06, 0.089469868060823549]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 5.5001260829747177e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 770

Equity: 1.66653309523 at time step 1778
Iteration: 771

Equity: 1.69665563536 at time step 1778
Iteration: 772

Equity: 1.70733918348 at time step 1778
Iteration: 773

Equity: 1.36475436926 at time step 1778
Iteration: 774

Equity: 1.47260689343 at time step 1778
Iteration: 775

Equity: 1.55668952104 at time step 1778
Iteration: 776

Equity: 1.61921164302 at time step 1778
Iteration: 777

Equity: 1.66205103281 at time step 1778
Iteration: 778

Equity: 1.68959857023 at time step 1778
Iteration: 779


Average loss: -363.784195 in 10 episodes

Increasing batch size to 10
Have run 78 batch updates
Next update at 790

[]
Equity: 1.40642450355 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.5481381584579319, 0.0069047538699328745, 0.0043622889595257173, 0.00066027664029439791, 0.24664958559318756]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 780

Equity: 1.45454900906 at time step 1778
Iteration: 781

Equity: 1.54337165233 at time step 1778
Iteration: 782

Equity: 1.61036865734 at time step 1778
Iteration: 783

Equity: 1.65647174925 at time step 1778
Iteration: 784

Equity: 1.68619153248 at time step 1778
Iteration: 785

Equity: 1.72167204347 at time step 1778
Iteration: 786

Equity: 1.66335075984 at time step 1778
Iteration: 787

Equity: 1.4469146732 at time step 1778
Iteration: 788

Equity: 1.44056469413 at time step 1778
Iteration: 789


Average loss: -572.602124 in 10 episodes

Increasing batch size to 10
Have run 79 batch updates
Next update at 800

[]
Equity: 1.5303213951 at time step 1778
Learning Rate: 0.0403991422391, Exploration Rate: 0.0807982844781
Avg Portfolio: [0.62899699828161726, 1.081179315134673e-09, 0.0079892225168497269, 5.093455693737851e-05, 0.16967790708428751]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 790

Equity: 1.60000648662 at time step 1778
Iteration: 791

Equity: 1.64919973963 at time step 1778
Iteration: 792

Equity: 1.69226554312 at time step 1778
Iteration: 793

Equity: 1.67193477355 at time step 1778
Iteration: 794

Equity: 1.72366168811 at time step 1778
Iteration: 795

Equity: 1.33103538892 at time step 1778
Iteration: 796

Equity: 1.45917407563 at time step 1778
Iteration: 797

Equity: 1.54576305179 at time step 1778
Iteration: 798

Equity: 1.61159570674 at time step 1778
Iteration: 799


Average loss: -306.134384 in 10 episodes

Increasing batch size to 10
Have run 80 batch updates
Next update at 810

[]
Equity: 1.65711119224 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.74405076663660175, 9.0939695126055083e-05, 0.0010266390256147323, 1.2585539183788242e-16, 0.061546718163529149]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 800

Equity: 1.71188954017 at time step 1778
Iteration: 801

Equity: 1.37915360755 at time step 1778
Iteration: 802

Equity: 1.4667780384 at time step 1778
Iteration: 803

Equity: 1.55117858679 at time step 1778
Iteration: 804

Equity: 1.61523675751 at time step 1778
Iteration: 805

Equity: 1.65943865139 at time step 1778
Iteration: 806

Equity: 1.68796710878 at time step 1778
Iteration: 807

Equity: 1.36483415165 at time step 1778
Iteration: 808

Equity: 1.4565325233 at time step 1778
Iteration: 809


Average loss: -320.601548 in 10 episodes

Increasing batch size to 10
Have run 81 batch updates
Next update at 820

[]
Equity: 1.54492526957 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.64420296488327833, 0.00082886050326885655, 6.6590220607848185e-10, 6.4511973509936787e-05, 0.16161872549491196]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 810

Equity: 1.61117159443 at time step 1778
Iteration: 811

Equity: 1.65686481461 at time step 1778
Iteration: 812

Equity: 1.68638911232 at time step 1778
Iteration: 813

Equity: 1.58511257207 at time step 1778
Iteration: 814

Equity: 1.5785199324 at time step 1778
Iteration: 815

Equity: 1.64111459242 at time step 1778
Iteration: 816

Equity: 1.6308993703 at time step 1778
Iteration: 817

Equity: 1.3363495517 at time step 1778
Iteration: 818

Equity: 1.45995207594 at time step 1778
Iteration: 819


Average loss: -364.153066 in 10 episodes

Increasing batch size to 10
Have run 82 batch updates
Next update at 830

[]
Equity: 1.54560059154 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.64402723621556468, 0.00014527849250449093, 0.0018802145039958356, 1.0157794904731254e-09, 0.16066233329302573]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 820

Equity: 1.61118709504 at time step 1778
Iteration: 821

Equity: 1.65673692008 at time step 1778
Iteration: 822

Equity: 1.68626305736 at time step 1778
Iteration: 823

Equity: 1.46429793334 at time step 1778
Iteration: 824

Equity: 1.43697682566 at time step 1778
Iteration: 825

Equity: 1.53206912474 at time step 1778
Iteration: 826

Equity: 1.60267903108 at time step 1778
Iteration: 827

Equity: 1.65146151944 at time step 1778
Iteration: 828

Equity: 1.68306727501 at time step 1778
Iteration: 829


Average loss: -205.984763 in 10 episodes

Increasing batch size to 10
Have run 83 batch updates
Next update at 840

[]
Equity: 1.67515256472 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.75252600929843716, 0.008742753581490641, 0.011194765617248758, 0.011012117832142846, 0.023239417191551929]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9535137754636085, 1.9884712123806014, 1.5053366190972788]
Iteration: 830

Equity: 1.63838331978 at time step 1778
Iteration: 831

Equity: 1.55287074164 at time step 1778
Iteration: 832

Equity: 1.6339167694 at time step 1778
Iteration: 833

Equity: 1.65067557589 at time step 1778
Iteration: 834

Equity: 1.57726889672 at time step 1778
Iteration: 835

Equity: 1.36146525377 at time step 1778
Iteration: 836

Equity: 1.45624297845 at time step 1778
Iteration: 837

Equity: 1.54447392368 at time step 1778
Iteration: 838

Equity: 1.61051884412 at time step 1778
Iteration: 839


Average loss: -335.590119 in 10 episodes

Increasing batch size to 10
Have run 84 batch updates
Next update at 850

[]
Equity: 1.65628931028 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.74339495691275681, 3.0718379851328074e-16, 0.00031523119266649503, 1.1952643647677751e-06, 0.063003680151081598]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 2.9787188280628794, 2.0155794439716419, 1.5053366190972788]
Iteration: 840

Equity: 1.68597523204 at time step 1778
Iteration: 841

Equity: 1.41467011484 at time step 1778
Iteration: 842

Equity: 1.51660028704 at time step 1778
Iteration: 843

Equity: 1.40475908304 at time step 1778
Iteration: 844

Equity: 1.50058959058 at time step 1778
Iteration: 845

Equity: 1.57818983885 at time step 1778
Iteration: 846

Equity: 1.63448808731 at time step 1778
Iteration: 847

Equity: 1.67211481767 at time step 1778
Iteration: 848

Equity: 1.62856500483 at time step 1778
Iteration: 849


Average loss: -679.753457 in 10 episodes

Increasing batch size to 10
Have run 85 batch updates
Next update at 860

[]
Equity: 1.35579145225 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.47867296369907653, 0.002232384718612358, 7.1249031135936449e-07, 0.010430741128447815, 0.31537826148442294]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 850

Equity: 1.47681124385 at time step 1778
Iteration: 851

Equity: 1.56175099689 at time step 1778
Iteration: 852

Equity: 1.623115853 at time step 1778
Iteration: 853

Equity: 1.66469557593 at time step 1778
Iteration: 854

Equity: 1.69127499489 at time step 1778
Iteration: 855

Equity: 1.46956585137 at time step 1778
Iteration: 856

Equity: 1.38805195116 at time step 1778
Iteration: 857

Equity: 1.48883219135 at time step 1778
Iteration: 858

Equity: 1.57025738526 at time step 1778
Iteration: 859


Average loss: -270.569236 in 10 episodes

Increasing batch size to 10
Have run 86 batch updates
Next update at 870

[]
Equity: 1.62937373372 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.7201634079852175, 0.00047414153784923756, 0.00062679876166098843, 1.2787643835175708e-16, 0.085450715236143268]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.3417737658001932e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 860

Equity: 1.66893924695 at time step 1778
Iteration: 861

Equity: 1.71106358412 at time step 1778
Iteration: 862

Equity: 1.55850106671 at time step 1778
Iteration: 863

Equity: 1.40016877178 at time step 1778
Iteration: 864

Equity: 1.49899531799 at time step 1778
Iteration: 865

Equity: 1.57788461489 at time step 1778
Iteration: 866

Equity: 1.63460416551 at time step 1778
Iteration: 867

Equity: 1.67230190988 at time step 1778
Iteration: 868

Equity: 1.70528164295 at time step 1778
Iteration: 869


Average loss: -663.730325 in 10 episodes

Increasing batch size to 10
Have run 87 batch updates
Next update at 880

[]
Equity: 1.51239010795 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.51514880576231759, 0.012464250821478607, 0.014983018196663818, 0.0038743713353012166, 0.26024461740510885]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 870

Equity: 1.43539373125 at time step 1778
Iteration: 871

Equity: 1.52799545216 at time step 1778
Iteration: 872

Equity: 1.59926981384 at time step 1778
Iteration: 873

Equity: 1.6490749756 at time step 1778
Iteration: 874

Equity: 1.68152302841 at time step 1778
Iteration: 875

Equity: 1.61604752351 at time step 1778
Iteration: 876

Equity: 1.57368895784 at time step 1778
Iteration: 877

Equity: 1.36595643039 at time step 1778
Iteration: 878

Equity: 1.46644420521 at time step 1778
Iteration: 879


Average loss: -323.975805 in 10 episodes

Increasing batch size to 10
Have run 88 batch updates
Next update at 890

[]
Equity: 1.55166658968 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.64957746776133063, 0.00074726753172229383, 0.0055200347364419648, 1.4740163730590503e-12, 0.15087029348990308]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53343278798424409]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 880

Equity: 1.61585923785 at time step 1778
Iteration: 881

Equity: 1.6599435666 at time step 1778
Iteration: 882

Equity: 1.62778021029 at time step 1778
Iteration: 883

Equity: 1.76054137414 at time step 1778
Iteration: 884

Equity: 1.63091246337 at time step 1778
Iteration: 885

Equity: 1.46901254177 at time step 1778
Iteration: 886

Equity: 1.38901900496 at time step 1778
Iteration: 887

Equity: 1.48677892457 at time step 1778
Iteration: 888

Equity: 1.56753046526 at time step 1778
Iteration: 889


Average loss: -283.213407 in 10 episodes

Increasing batch size to 10
Have run 89 batch updates
Next update at 900

[]
Equity: 1.62704584369 at time step 1778
Learning Rate: 0.0391871679719, Exploration Rate: 0.0783743359438
Avg Portfolio: [0.717621814673576, 0.00019193306412478248, 0.0028751486719091296, 3.3337349096196622e-16, 0.086026167111261043]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 890

Equity: 1.66727324977 at time step 1778
Iteration: 891

Equity: 1.7091665298 at time step 1778
Iteration: 892

Equity: 1.47258451357 at time step 1778
Iteration: 893

Equity: 1.40298031988 at time step 1778
Iteration: 894

Equity: 1.50296795761 at time step 1778
Iteration: 895

Equity: 1.58058960964 at time step 1778
Iteration: 896

Equity: 1.636266861 at time step 1778
Iteration: 897

Equity: 1.67329692741 at time step 1778
Iteration: 898

Equity: 1.69554790012 at time step 1778
Iteration: 899


Average loss: -590.877338 in 10 episodes

Increasing batch size to 10
Have run 90 batch updates
Next update at 910

[]
Equity: 1.51022070004 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.54359048383715491, 0.010767634060668236, 0.012605837835053991, 0.01579847393408082, 0.22395263385391412]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 900

Equity: 1.42306629215 at time step 1778
Iteration: 901

Equity: 1.51918019972 at time step 1778
Iteration: 902

Equity: 1.59210975052 at time step 1778
Iteration: 903

Equity: 1.643880883 at time step 1778
Iteration: 904

Equity: 1.67808437832 at time step 1778
Iteration: 905

Equity: 1.31674664148 at time step 1778
Iteration: 906

Equity: 1.44754385585 at time step 1778
Iteration: 907

Equity: 1.53740785803 at time step 1778
Iteration: 908

Equity: 1.60536625051 at time step 1778
Iteration: 909


Average loss: -233.551616 in 10 episodes

Increasing batch size to 10
Have run 91 batch updates
Next update at 920

[]
Equity: 1.65283286642 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.74018668417066213, 4.5757300869681229e-17, 0.0017760904023230754, 1.2608878843586307e-06, 0.064751028060000937]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 910

Equity: 1.68378496581 at time step 1778
Iteration: 911

Equity: 1.62692860399 at time step 1778
Iteration: 912

Equity: 1.37585699342 at time step 1778
Iteration: 913

Equity: 1.47585721119 at time step 1778
Iteration: 914

Equity: 1.55848135117 at time step 1778
Iteration: 915

Equity: 1.6203891231 at time step 1778
Iteration: 916

Equity: 1.6628065768 at time step 1778
Iteration: 917

Equity: 1.64556694089 at time step 1778
Iteration: 918

Equity: 1.73535015442 at time step 1778
Iteration: 919


Average loss: -679.613067 in 10 episodes

Increasing batch size to 10
Have run 92 batch updates
Next update at 930

[]
Equity: 1.71417740805 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.69008983021312287, 0.010763426447905119, 0.0081833566743167961, 0.010523128337294839, 0.087155321848230757]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 920

Equity: 1.66498924736 at time step 1778
Iteration: 921

Equity: 1.49507743773 at time step 1778
Iteration: 922

Equity: 1.37371604314 at time step 1778
Iteration: 923

Equity: 1.47677390998 at time step 1778
Iteration: 924

Equity: 1.56075361877 at time step 1778
Iteration: 925

Equity: 1.6226215336 at time step 1778
Iteration: 926

Equity: 1.66450202779 at time step 1778
Iteration: 927

Equity: 1.67376825859 at time step 1778
Iteration: 928

Equity: 1.68811597268 at time step 1778
Iteration: 929


Average loss: -324.222447 in 10 episodes

Increasing batch size to 10
Have run 93 batch updates
Next update at 940

[]
Equity: 1.37558987702 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.49518327145113317, 0.0044568476088479286, 0.018173833183047525, 0.0029234616907255098, 0.28597764958711702]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 930

Equity: 1.44948077474 at time step 1778
Iteration: 931

Equity: 1.53835858978 at time step 1778
Iteration: 932

Equity: 1.60639397421 at time step 1778
Iteration: 933

Equity: 1.65369468446 at time step 1778
Iteration: 934

Equity: 1.68439339423 at time step 1778
Iteration: 935

Equity: 1.62816133689 at time step 1778
Iteration: 936

Equity: 1.58158272335 at time step 1778
Iteration: 937

Equity: 1.45013343844 at time step 1778
Iteration: 938

Equity: 1.44747661519 at time step 1778
Iteration: 939


Average loss: -385.318738 in 10 episodes

Increasing batch size to 10
Have run 94 batch updates
Next update at 950

[]
Equity: 1.53696583858 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.63643047889508719, 0.00024064897251935218, 9.7411756517651016e-10, 8.0867687034023731e-05, 0.16996306699211108]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 940

Equity: 1.60510151511 at time step 1778
Iteration: 941

Equity: 1.65269960508 at time step 1778
Iteration: 942

Equity: 1.68372018431 at time step 1778
Iteration: 943

Equity: 1.50198047089 at time step 1778
Iteration: 944

Equity: 1.40806339308 at time step 1778
Iteration: 945

Equity: 1.50263840217 at time step 1778
Iteration: 946

Equity: 1.57941863274 at time step 1778
Iteration: 947

Equity: 1.63521607642 at time step 1778
Iteration: 948

Equity: 1.67254323851 at time step 1778
Iteration: 949


Average loss: -311.773948 in 10 episodes

Increasing batch size to 10
Have run 95 batch updates
Next update at 960

[]
Equity: 1.68753875397 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.76634090210040673, 0.00085457990524510539, 0.0019435915817395766, 0.0040612023171800868, 0.033514787616301112]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 950

Equity: 1.77872090874 at time step 1778
Iteration: 951

Equity: 1.90737416663 at time step 1778
Iteration: 952

Equity: 1.29163647839 at time step 1778
Iteration: 953

Equity: 1.45974547371 at time step 1778
Iteration: 954

Equity: 1.5478780934 at time step 1778
Iteration: 955

Equity: 1.61304254585 at time step 1778
Iteration: 956

Equity: 1.65797777343 at time step 1778
Iteration: 957

Equity: 1.68704082566 at time step 1778
Iteration: 958

Equity: 1.49494179223 at time step 1778
Iteration: 959


Average loss: -678.460634 in 10 episodes

Increasing batch size to 10
Have run 96 batch updates
Next update at 970

[]
Equity: 1.40666363741 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.51219660505209275, 0.0071987215082727034, 0.0098531546057224074, 8.9748831911975793e-07, 0.27746568486646422]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0010008946090192, 2.0155794439716419, 1.5053366190972788]
Iteration: 960

Equity: 1.50433605863 at time step 1778
Iteration: 961

Equity: 1.58183782787 at time step 1778
Iteration: 962

Equity: 1.63729044144 at time step 1778
Iteration: 963

Equity: 1.67401900571 at time step 1778
Iteration: 964

Equity: 1.67526660676 at time step 1778
Iteration: 965

Equity: 1.77123734082 at time step 1778
Iteration: 966

Equity: 1.56531174124 at time step 1778
Iteration: 967

Equity: 1.4618887041 at time step 1778
Iteration: 968

Equity: 1.39936489657 at time step 1778
Iteration: 969


Average loss: -380.812210 in 10 episodes

Increasing batch size to 10
Have run 97 batch updates
Next update at 980

[]
Equity: 1.49778554376 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.60038052622493177, 0.0021136295088713618, 1.0354104108174387e-09, 4.7182601377859305e-05, 0.20417372415028145]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 970

Equity: 1.57654490149 at time step 1778
Iteration: 971

Equity: 1.63350723701 at time step 1778
Iteration: 972

Equity: 1.67153423182 at time step 1778
Iteration: 973

Equity: 1.7151138502 at time step 1778
Iteration: 974

Equity: 1.58015367667 at time step 1778
Iteration: 975

Equity: 1.39009628622 at time step 1778
Iteration: 976

Equity: 1.48800626997 at time step 1778
Iteration: 977

Equity: 1.56858456152 at time step 1778
Iteration: 978

Equity: 1.62781822769 at time step 1778
Iteration: 979


Average loss: -330.209960 in 10 episodes

Increasing batch size to 10
Have run 98 batch updates
Next update at 990

[]
Equity: 1.66778643948 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.75297598533855559, 7.562996144412164e-05, 0.0027205920650465766, 5.4723834585382118e-20, 0.050942856155826534]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.0143487550889211, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 980

Equity: 1.67238861452 at time step 1778
Iteration: 981

Equity: 1.43592457549 at time step 1778
Iteration: 982

Equity: 1.4562735883 at time step 1778
Iteration: 983

Equity: 1.54296139564 at time step 1778
Iteration: 984

Equity: 1.6092607409 at time step 1778
Iteration: 985

Equity: 1.65543408828 at time step 1778
Iteration: 986

Equity: 1.68543450773 at time step 1778
Iteration: 987

Equity: 1.8108240757 at time step 1778
Iteration: 988

Equity: 1.66413012573 at time step 1778
Iteration: 989


Average loss: -670.321307 in 10 episodes

Increasing batch size to 10
Have run 99 batch updates
Next update at 1000

[]
Equity: 1.33608950942 at time step 1778
Learning Rate: 0.0380115529327, Exploration Rate: 0.0760231058655
Avg Portfolio: [0.47523710979884992, 0.010581791076364082, 0.00059819243404929617, 0.0071053355102369264, 0.31319263470137176]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 990

Equity: 1.45924611637 at time step 1778
Iteration: 991

Equity: 1.54895344821 at time step 1778
Iteration: 992

Equity: 1.61463759974 at time step 1778
Iteration: 993

Equity: 1.65935381639 at time step 1778
Iteration: 994

Equity: 1.68801766422 at time step 1778
Iteration: 995

Equity: 1.38529367964 at time step 1778
Iteration: 996

Equity: 1.42706428851 at time step 1778
Iteration: 997

Equity: 1.51888417563 at time step 1778
Iteration: 998

Equity: 1.59171161521 at time step 1778
Iteration: 999


Average loss: -305.402457 in 10 episodes

Increasing batch size to 10
Have run 100 batch updates
Next update at 1010

[]
Equity: 1.64366874387 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.73227752243907007, 7.7503710053354797e-05, 0.0017247699427532517, 1.8410554401865621e-16, 0.072635267428993816]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1000

Equity: 1.67798100851 at time step 1778
Iteration: 1001

Equity: 1.75180847585 at time step 1778
Iteration: 1002

Equity: 1.37602469693 at time step 1778
Iteration: 1003

Equity: 1.45848285482 at time step 1778
Iteration: 1004

Equity: 1.54832653498 at time step 1778
Iteration: 1005

Equity: 1.6140720211 at time step 1778
Iteration: 1006

Equity: 1.65892728402 at time step 1778
Iteration: 1007

Equity: 1.68773095461 at time step 1778
Iteration: 1008

Equity: 1.68055748408 at time step 1778
Iteration: 1009


Average loss: -753.142633 in 10 episodes

Increasing batch size to 10
Have run 101 batch updates
Next update at 1020

[]
Equity: 1.7046864815 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.6953133103362511, 0.0056051555630098867, 0.016027065558425299, 0.0057078132727075206, 0.084061718790478704]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1010

Equity: 1.37485509251 at time step 1778
Iteration: 1011

Equity: 1.47359491398 at time step 1778
Iteration: 1012

Equity: 1.55699674559 at time step 1778
Iteration: 1013

Equity: 1.61953985719 at time step 1778
Iteration: 1014

Equity: 1.66233428533 at time step 1778
Iteration: 1015

Equity: 1.63850373423 at time step 1778
Iteration: 1016

Equity: 1.45891025086 at time step 1778
Iteration: 1017

Equity: 1.42605155218 at time step 1778
Iteration: 1018

Equity: 1.52339145536 at time step 1778
Iteration: 1019


Average loss: -289.314903 in 10 episodes

Increasing batch size to 10
Have run 102 batch updates
Next update at 1030

[]
Equity: 1.59610221362 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.69082319131728953, 0.00065584324110717245, 5.2249945803560611e-13, 2.1720410197998034e-05, 0.11521430855175435]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1020

Equity: 1.64692621273 at time step 1778
Iteration: 1021

Equity: 1.68014824494 at time step 1778
Iteration: 1022

Equity: 1.74992306858 at time step 1778
Iteration: 1023

Equity: 1.37637055162 at time step 1778
Iteration: 1024

Equity: 1.47536130621 at time step 1778
Iteration: 1025

Equity: 1.55800284073 at time step 1778
Iteration: 1026

Equity: 1.62005316604 at time step 1778
Iteration: 1027

Equity: 1.66259420149 at time step 1778
Iteration: 1028

Equity: 1.68993609974 at time step 1778
Iteration: 1029


Average loss: -420.035813 in 10 episodes

Increasing batch size to 10
Have run 103 batch updates
Next update at 1040

[]
Equity: 1.37950148883 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.56311354334334851, 0.0026378596799561688, 0.0010891669349804983, 0.0024526389034153239, 0.23742185465917084]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1030

Equity: 1.44995025755 at time step 1778
Iteration: 1031

Equity: 1.53764673409 at time step 1778
Iteration: 1032

Equity: 1.6054734441 at time step 1778
Iteration: 1033

Equity: 1.65294247216 at time step 1778
Iteration: 1034

Equity: 1.68387540085 at time step 1778
Iteration: 1035

Equity: 1.54850955246 at time step 1778
Iteration: 1036

Equity: 1.34854996682 at time step 1778
Iteration: 1037

Equity: 1.47002498368 at time step 1778
Iteration: 1038

Equity: 1.55600428881 at time step 1778
Iteration: 1039


Average loss: -650.094949 in 10 episodes

Increasing batch size to 10
Have run 104 batch updates
Next update at 1050

[]
Equity: 1.61885436203 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.71033684604885217, 7.2300917443933569e-16, 0.0026326202885661979, 1.41895916311558e-05, 0.093731407591819596]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1040

Equity: 1.66182137915 at time step 1778
Iteration: 1041

Equity: 1.6894510406 at time step 1778
Iteration: 1042

Equity: 1.4991394831 at time step 1778
Iteration: 1043

Equity: 1.39441329524 at time step 1778
Iteration: 1044

Equity: 1.492903797 at time step 1778
Iteration: 1045

Equity: 1.57191779303 at time step 1778
Iteration: 1046

Equity: 1.62989707908 at time step 1778
Iteration: 1047

Equity: 1.66904568834 at time step 1778
Iteration: 1048

Equity: 1.67746391234 at time step 1778
Iteration: 1049


Average loss: -617.773221 in 10 episodes

Increasing batch size to 10
Have run 105 batch updates
Next update at 1060

[]
Equity: 1.3577296385 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.47221042098552057, 0.0088087507039272296, 8.5065011322663144e-07, 0.00429059383335729, 0.32140444734795276]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1050

Equity: 1.46972872818 at time step 1778
Iteration: 1051

Equity: 1.5561328605 at time step 1778
Iteration: 1052

Equity: 1.61948356182 at time step 1778
Iteration: 1053

Equity: 1.6624686669 at time step 1778
Iteration: 1054

Equity: 1.68994190056 at time step 1778
Iteration: 1055

Equity: 1.51498248642 at time step 1778
Iteration: 1056

Equity: 1.53130589947 at time step 1778
Iteration: 1057

Equity: 1.42622485334 at time step 1778
Iteration: 1058

Equity: 1.51856318039 at time step 1778
Iteration: 1059


Average loss: -492.356229 in 10 episodes

Increasing batch size to 10
Have run 106 batch updates
Next update at 1070

[]
Equity: 1.59161433454 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.68595097969569874, 0.00032821421726416181, 0.0043063153373748544, 6.9056966633405137e-13, 0.11612955426984387]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1060

Equity: 1.64365139005 at time step 1778
Iteration: 1061

Equity: 1.67798555508 at time step 1778
Iteration: 1062

Equity: 1.57011116132 at time step 1778
Iteration: 1063

Equity: 1.39472603042 at time step 1778
Iteration: 1064

Equity: 1.48998832961 at time step 1778
Iteration: 1065

Equity: 1.56930570007 at time step 1778
Iteration: 1066

Equity: 1.62803076442 at time step 1778
Iteration: 1067

Equity: 1.66782612239 at time step 1778
Iteration: 1068

Equity: 1.59312715443 at time step 1778
Iteration: 1069


Average loss: -567.509354 in 10 episodes

Increasing batch size to 10
Have run 107 batch updates
Next update at 1080

[]
Equity: 1.39013446804 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.49310009998899335, 0.0032941682367401606, 0.0022912593690583394, 5.1484750504402844e-07, 0.30802902107857388]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.1131399837582776e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1070

Equity: 1.48762810068 at time step 1778
Iteration: 1071

Equity: 1.56814477183 at time step 1778
Iteration: 1072

Equity: 1.62746506294 at time step 1778
Iteration: 1073

Equity: 1.66754565927 at time step 1778
Iteration: 1074

Equity: 1.68410837406 at time step 1778
Iteration: 1075

Equity: 1.44737255095 at time step 1778
Iteration: 1076

Equity: 1.34780868343 at time step 1778
Iteration: 1077

Equity: 1.4605377324 at time step 1778
Iteration: 1078

Equity: 1.54816703908 at time step 1778
Iteration: 1079


Average loss: -330.764301 in 10 episodes

Increasing batch size to 10
Have run 108 batch updates
Next update at 1090

[]
Equity: 1.61381079423 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.70640746667565724, 0.00059752937237777376, 0.0011606674769612424, 2.3962467404661014e-13, 0.098549399995635709]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1080

Equity: 1.65875366238 at time step 1778
Iteration: 1081

Equity: 1.68238993743 at time step 1778
Iteration: 1082

Equity: 1.61079566278 at time step 1778
Iteration: 1083

Equity: 1.583582981 at time step 1778
Iteration: 1084

Equity: 1.40622254164 at time step 1778
Iteration: 1085

Equity: 1.45309734877 at time step 1778
Iteration: 1086

Equity: 1.54226598819 at time step 1778
Iteration: 1087

Equity: 1.60893585782 at time step 1778
Iteration: 1088

Equity: 1.65522330338 at time step 1778
Iteration: 1089


Average loss: -292.003453 in 10 episodes

Increasing batch size to 10
Have run 109 batch updates
Next update at 1100

[]
Equity: 1.68529480726 at time step 1778
Learning Rate: 0.0368712063447, Exploration Rate: 0.0737424126895
Avg Portfolio: [0.76802960761203209, 2.4706285739070977e-20, 0.0016684354283991475, 1.3845741997740603e-07, 0.037016882023019303]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1090

Equity: 1.6100867116 at time step 1778
Iteration: 1091

Equity: 1.30975241068 at time step 1778
Iteration: 1092

Equity: 1.45199804003 at time step 1778
Iteration: 1093

Equity: 1.5435666562 at time step 1778
Iteration: 1094

Equity: 1.61032447569 at time step 1778
Iteration: 1095

Equity: 1.65627558534 at time step 1778
Iteration: 1096

Equity: 1.68600203591 at time step 1778
Iteration: 1097

Equity: 1.70620878033 at time step 1778
Iteration: 1098

Equity: 1.54057550843 at time step 1778
Iteration: 1099


Average loss: -581.610148 in 10 episodes

Increasing batch size to 10
Have run 110 batch updates
Next update at 1110

[]
Equity: 1.42986119711 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.53780741226204076, 0.0037511575528635585, 3.1025440197498453e-06, 0.0016114534674418262, 0.26354193769450557]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1100

Equity: 1.52562396606 at time step 1778
Iteration: 1101

Equity: 1.59753248831 at time step 1778
Iteration: 1102

Equity: 1.64782882081 at time step 1778
Iteration: 1103

Equity: 1.68070181018 at time step 1778
Iteration: 1104

Equity: 1.59585776185 at time step 1778
Iteration: 1105

Equity: 1.38210298304 at time step 1778
Iteration: 1106

Equity: 1.47992593295 at time step 1778
Iteration: 1107

Equity: 1.56152691489 at time step 1778
Iteration: 1108

Equity: 1.62253608857 at time step 1778
Iteration: 1109


Average loss: -359.425364 in 10 episodes

Increasing batch size to 10
Have run 111 batch updates
Next update at 1120

[]
Equity: 1.66421778721 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.74986485996460972, 7.7014930289746522e-21, 0.0027344730342088353, 8.3431110935001438e-08, 0.054115647090941715]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1110

Equity: 1.69094525077 at time step 1778
Iteration: 1111

Equity: 1.85835266379 at time step 1778
Iteration: 1112

Equity: 1.62784444212 at time step 1778
Iteration: 1113

Equity: 1.36194492576 at time step 1778
Iteration: 1114

Equity: 1.46541937869 at time step 1778
Iteration: 1115

Equity: 1.55188591288 at time step 1778
Iteration: 1116

Equity: 1.61639584442 at time step 1778
Iteration: 1117

Equity: 1.66043022632 at time step 1778
Iteration: 1118

Equity: 1.68866307224 at time step 1778
Iteration: 1119


Average loss: -445.609321 in 10 episodes

Increasing batch size to 10
Have run 112 batch updates
Next update at 1130

[]
Equity: 1.52323236779 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.66774017953982567, 0.021800843472504806, 0.017394662338843535, 0.018057476702621433, 0.081721901467074171]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1120

Equity: 1.65103603084 at time step 1778
Iteration: 1121

Equity: 1.56611774464 at time step 1778
Iteration: 1122

Equity: 1.42721066511 at time step 1778
Iteration: 1123

Equity: 1.52255385434 at time step 1778
Iteration: 1124

Equity: 1.59463694928 at time step 1778
Iteration: 1125

Equity: 1.64561436983 at time step 1778
Iteration: 1126

Equity: 1.67919998476 at time step 1778
Iteration: 1127

Equity: 1.71467915141 at time step 1778
Iteration: 1128

Equity: 1.61653242087 at time step 1778
Iteration: 1129


Average loss: -573.148064 in 10 episodes

Increasing batch size to 10
Have run 113 batch updates
Next update at 1140

[]
Equity: 1.6550039187 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.7140601378846243, 0.024265033462011115, 0.025025824794327925, 0.006154549085079967, 0.037209518294827638]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1130

Equity: 1.4337656035 at time step 1778
Iteration: 1131

Equity: 1.43704560681 at time step 1778
Iteration: 1132

Equity: 1.53053258781 at time step 1778
Iteration: 1133

Equity: 1.60079324793 at time step 1778
Iteration: 1134

Equity: 1.64990662622 at time step 1778
Iteration: 1135

Equity: 1.68198069013 at time step 1778
Iteration: 1136

Equity: 1.67359357706 at time step 1778
Iteration: 1137

Equity: 1.54414370373 at time step 1778
Iteration: 1138

Equity: 1.4134058622 at time step 1778
Iteration: 1139


Average loss: -300.224854 in 10 episodes

Increasing batch size to 10
Have run 114 batch updates
Next update at 1150

[]
Equity: 1.4338176939 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.53733459089424451, 0.0039940366812148843, 0.011976291779946231, 2.1020507617621634e-06, 0.25340804211470308]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1140

Equity: 1.52588258057 at time step 1778
Iteration: 1141

Equity: 1.59741033805 at time step 1778
Iteration: 1142

Equity: 1.64771251494 at time step 1778
Iteration: 1143

Equity: 1.68062009535 at time step 1778
Iteration: 1144

Equity: 1.43613194061 at time step 1778
Iteration: 1145

Equity: 1.44646245881 at time step 1778
Iteration: 1146

Equity: 1.53767311117 at time step 1778
Iteration: 1147

Equity: 1.60569320218 at time step 1778
Iteration: 1148

Equity: 1.65307248121 at time step 1778
Iteration: 1149


Average loss: -207.866513 in 10 episodes

Increasing batch size to 10
Have run 115 batch updates
Next update at 1160

[]
Equity: 1.68394279848 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.7671183990452799, 4.3198716599600954e-20, 0.00014219022348553305, 1.8655386002601914e-07, 0.039454287698246]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1150

Equity: 1.5360381682 at time step 1778
Iteration: 1151

Equity: 1.33826593783 at time step 1778
Iteration: 1152

Equity: 1.46558221052 at time step 1778
Iteration: 1153

Equity: 1.5519062548 at time step 1778
Iteration: 1154

Equity: 1.61600701031 at time step 1778
Iteration: 1155

Equity: 1.66000025887 at time step 1778
Iteration: 1156

Equity: 1.68833464848 at time step 1778
Iteration: 1157

Equity: 1.55749040967 at time step 1778
Iteration: 1158

Equity: 1.38935918759 at time step 1778
Iteration: 1159


Average loss: -685.472051 in 10 episodes

Increasing batch size to 10
Have run 116 batch updates
Next update at 1170

[]
Equity: 1.48631908531 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.5879407253040797, 0.00086676716908519827, 0.0038870839786087673, 6.7417676679966771e-10, 0.21402048639492033]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1160

Equity: 1.5668825544 at time step 1778
Iteration: 1161

Equity: 1.62648782452 at time step 1778
Iteration: 1162

Equity: 1.666874586 at time step 1778
Iteration: 1163

Equity: 1.68336639973 at time step 1778
Iteration: 1164

Equity: 1.66980788488 at time step 1778
Iteration: 1165

Equity: 1.68841635053 at time step 1778
Iteration: 1166

Equity: 1.50915297157 at time step 1778
Iteration: 1167

Equity: 1.48201578556 at time step 1778
Iteration: 1168

Equity: 1.44265640591 at time step 1778
Iteration: 1169


Average loss: -330.279413 in 10 episodes

Increasing batch size to 10
Have run 117 batch updates
Next update at 1180

[]
Equity: 1.53302965312 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.63292760399403925, 0.00061680239967552267, 1.3843704518019652e-09, 5.5330835317791886e-05, 0.17311532490746862]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1170

Equity: 1.60235342705 at time step 1778
Iteration: 1171

Equity: 1.65091309805 at time step 1778
Iteration: 1172

Equity: 1.68260961169 at time step 1778
Iteration: 1173

Equity: 1.50059786322 at time step 1778
Iteration: 1174

Equity: 1.40636065978 at time step 1778
Iteration: 1175

Equity: 1.50411379091 at time step 1778
Iteration: 1176

Equity: 1.58169293915 at time step 1778
Iteration: 1177

Equity: 1.63720484548 at time step 1778
Iteration: 1178

Equity: 1.67397224004 at time step 1778
Iteration: 1179


Average loss: -209.629416 in 10 episodes

Increasing batch size to 10
Have run 118 batch updates
Next update at 1190

[]
Equity: 1.55646499276 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.73056201510036156, 0.0051132352344053856, 0.0018250476508739758, 0.0085749155217260051, 0.060639850013505595]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1180

Equity: 1.27350418974 at time step 1778
Iteration: 1181

Equity: 1.4694549791 at time step 1778
Iteration: 1182

Equity: 1.5569239162 at time step 1778
Iteration: 1183

Equity: 1.61964429538 at time step 1778
Iteration: 1184

Equity: 1.66234983206 at time step 1778
Iteration: 1185

Equity: 1.68977902202 at time step 1778
Iteration: 1186

Equity: 1.4435111233 at time step 1778
Iteration: 1187

Equity: 1.45080994307 at time step 1778
Iteration: 1188

Equity: 1.54029804012 at time step 1778
Iteration: 1189


Average loss: -609.938467 in 10 episodes

Increasing batch size to 10
Have run 119 batch updates
Next update at 1200

[]
Equity: 1.60749627061 at time step 1778
Learning Rate: 0.0357650701544, Exploration Rate: 0.0715301403088
Avg Portfolio: [0.70010377566114013, 8.6976307755547803e-14, 0.0036381091169681488, 1.378818238751777e-05, 0.10295939056028749]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1190

Equity: 1.65426145567 at time step 1778
Iteration: 1191

Equity: 1.68468823404 at time step 1778
Iteration: 1192

Equity: 1.64435321338 at time step 1778
Iteration: 1193

Equity: 1.45154280408 at time step 1778
Iteration: 1194

Equity: 1.42885545226 at time step 1778
Iteration: 1195

Equity: 1.52159314491 at time step 1778
Iteration: 1196

Equity: 1.59364739552 at time step 1778
Iteration: 1197

Equity: 1.64490204004 at time step 1778
Iteration: 1198

Equity: 1.6787350561 at time step 1778
Iteration: 1199


Average loss: -441.282471 in 10 episodes

Increasing batch size to 10
Have run 120 batch updates
Next update at 1210

[]
Equity: 1.74567477326 at time step 1778
Learning Rate: 0.0346921180498, Exploration Rate: 0.0693842360995
Avg Portfolio: [0.72886802901099901, 0.0040149677163767994, 0.0051881749160512785, 0.0060607638883451937, 0.06258312798909961]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1200

Equity: 1.32750124876 at time step 1778
Iteration: 1201

Equity: 1.46009526181 at time step 1778
Iteration: 1202

Equity: 1.54641014048 at time step 1778
Iteration: 1203

Equity: 1.61201740047 at time step 1778
Iteration: 1204

Equity: 1.65737660042 at time step 1778
Iteration: 1205

Equity: 1.68669678327 at time step 1778
Iteration: 1206

Equity: 1.45608273597 at time step 1778
Iteration: 1207

Equity: 1.41222326939 at time step 1778
Iteration: 1208

Equity: 1.5080174606 at time step 1778
Iteration: 1209


Average loss: -655.943343 in 10 episodes

Increasing batch size to 10
Have run 121 batch updates
Next update at 1220

[]
Equity: 1.68348099508 at time step 1778
Learning Rate: 0.0346921180498, Exploration Rate: 0.0693842360995
Avg Portfolio: [0.67863552471292365, 2.169928671293554e-15, 0.0027841258138790242, 1.605057382380536e-05, 0.12527936242024257]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1210


Equity: 1.73793523476 at time step 1778
Iteration: 1211

Equity: 1.74725907123 at time step 1778
Iteration: 1212

Equity: 1.81744600379 at time step 1778
Iteration: 1214

Equity: 1.79351522769 at time step 1778
Iteration: 1215

Equity: 1.76725907123 at time step 1778
Iteration: 1212

Equity: 1.79187875828 at time step 1778
Iteration: 1213

Equity: 1.81478282398 at time step 1778
Iteration: 1214

Equity: 1.77582363201 at time step 1778
Iteration: 1215

Equity: 1.91475452830 at time step 1778
Iteration: 1216

Equity: 1.80750282826 at time step 1778
Iteration: 1217

Equity: 1.76212852826 at time step 1778
Iteration: 1218

Equity: 1.84259587412 at time step 1778
Iteration: 1219

Average loss: -422.728548 in 10 episodes

Increasing batch size to 10
Have run 122 batch updates
Next update at 1230

[]
Equity: 1.88374281775 at time step 1778
Learning Rate: 0.0346921180498, Exploration Rate: 0.0693842360995
Avg Portfolio: [0.67863552471292365, 2.169928671293554e-15, 0.0027841258138790242, 1.605057382380536e-05, 0.12527936242024257]
Min Portfolio: [0.0, 0.0, 0.0, 0.0, 0.0]
Max Portfolio: [0.99640236808313143, 0.58850284418588716, 0.48952322892526423, 0.97310314663556929, 0.53414021602025108]
Min Gain or Loss: [0.81203030505932006, 0.011773518809409968, 0.4997663414307772, 3.0900322668480824e-06]
Max Gain or Loss: [91.105308700163121, 3.0623719303778687, 2.0155794439716419, 1.5053366190972788]
Iteration: 1220