Gradient Descent of a loss function
Objective: To perform the Gradient descent algorithm to a loss function:
`f(x) = (x+5)^2`
Python code:
import numpy as np
import matplotlib.pyplot as plt
def f(x):
return (x + 5)**2 # This is the loss function that we need to minimize
def df(x):
return 2*(x + 5) # Derivative of the loss function
curr_x = 3 # The algorithm will start at X = 3
rate = 0.01 # Learning rate
iters = 0 # no of iterations
precision = 0.000001 # This tells us when to stop the algorithm
max_iters = 10000 # This is the maximum number of iterations allowed for the algorithm
previous_step_size = 1 # this is the diffrence between current x value and previous x value
# Performing a while loop to calculate the local minima of the loss function
while previous_step_size > precision and iters < max_iters: # This statement means that loop will stop when previous step size value becomes close to precision value or no of iterations exceeds the max iteration limit.
prev_x = curr_x # Store current value in previous value
curr_x = prev_x - rate * df(prev_x) # Formula of Gradient Descent
previous_step_size = abs(curr_x - prev_x)
iters = iters + 1
print("The value of X at Iteration",iters, "is",curr_x)
print('The local minima occurs at X = ',curr_x)
Results:
The value of X at Iteration 1 is 2.84
The value of X at Iteration 2 is 2.6832
The value of X at Iteration 3 is 2.529536
The value of X at Iteration 4 is 2.37894528
The value of X at Iteration 5 is 2.2313663744
The value of X at Iteration 6 is 2.0867390469119997
The value of X at Iteration 7 is 1.9450042659737599
The value of X at Iteration 8 is 1.8061041806542846
The value of X at Iteration 9 is 1.669982097041199
The value of X at Iteration 10 is 1.5365824551003748
The value of X at Iteration 11 is 1.4058508059983674
The value of X at Iteration 12 is 1.2777337898784
The value of X at Iteration 13 is 1.152179114080832
The value of X at Iteration 14 is 1.0291355317992152
The value of X at Iteration 15 is 0.9085528211632309
The value of X at Iteration 16 is 0.7903817647399662
The value of X at Iteration 17 is 0.6745741294451669
The value of X at Iteration 18 is 0.5610826468562635
The value of X at Iteration 19 is 0.44986099391913825
The value of X at Iteration 20 is 0.3408637740407555
The value of X at Iteration 21 is 0.23404649855994042
The value of X at Iteration 22 is 0.1293655685887416
The value of X at Iteration 23 is 0.026778257216966764
The value of X at Iteration 24 is -0.07375730792737258
The value of X at Iteration 25 is -0.1722821617688251
The value of X at Iteration 26 is -0.2688365185334486
The value of X at Iteration 27 is -0.36345978816277963
The value of X at Iteration 28 is -0.45619059239952403
The value of X at Iteration 29 is -0.5470667805515336
The value of X at Iteration 30 is -0.6361254449405029
The value of X at Iteration 31 is -0.7234029360416929
The value of X at Iteration 32 is -0.8089348773208591
The value of X at Iteration 33 is -0.8927561797744419
The value of X at Iteration 34 is -0.9749010561789531
The value of X at Iteration 35 is -1.055403035055374
The value of X at Iteration 36 is -1.1342949743542665
The value of X at Iteration 37 is -1.2116090748671813
The value of X at Iteration 38 is -1.2873768933698377
The value of X at Iteration 39 is -1.361629355502441
The value of X at Iteration 40 is -1.4343967683923922
The value of X at Iteration 41 is -1.5057088330245443
The value of X at Iteration 42 is -1.5755946563640535
The value of X at Iteration 43 is -1.6440827632367725
The value of X at Iteration 44 is -1.711201107972037
The value of X at Iteration 45 is -1.7769770858125964
The value of X at Iteration 46 is -1.8414375440963444
The value of X at Iteration 47 is -1.9046087932144176
The value of X at Iteration 48 is -1.9665166173501292
The value of X at Iteration 49 is -2.0271862850031264
The value of X at Iteration 50 is -2.0866425593030637
The value of X at Iteration 51 is -2.1449097081170025
The value of X at Iteration 52 is -2.2020115139546625
The value of X at Iteration 53 is -2.257971283675569
The value of X at Iteration 54 is -2.312811858002058
The value of X at Iteration 55 is -2.3665556208420164
The value of X at Iteration 56 is -2.419224508425176
The value of X at Iteration 57 is -2.4708400182566725
The value of X at Iteration 58 is -2.521423217891539
The value of X at Iteration 59 is -2.570994753533708
The value of X at Iteration 60 is -2.619574858463034
The value of X at Iteration 61 is -2.667183361293773
The value of X at Iteration 62 is -2.713839694067898
The value of X at Iteration 63 is -2.75956290018654
The value of X at Iteration 64 is -2.804371642182809
The value of X at Iteration 65 is -2.8482842093391527
The value of X at Iteration 66 is -2.8913185251523696
The value of X at Iteration 67 is -2.9334921546493224
The value of X at Iteration 68 is -2.974822311556336
The value of X at Iteration 69 is -3.015325865325209
The value of X at Iteration 70 is -3.055019348018705
The value of X at Iteration 71 is -3.093918961058331
The value of X at Iteration 72 is -3.1320405818371646
The value of X at Iteration 73 is -3.1693997702004215
The value of X at Iteration 74 is -3.206011774796413
The value of X at Iteration 75 is -3.2418915393004846
The value of X at Iteration 76 is -3.277053708514475
The value of X at Iteration 77 is -3.3115126343441856
The value of X at Iteration 78 is -3.345282381657302
The value of X at Iteration 79 is -3.378376734024156
The value of X at Iteration 80 is -3.4108091993436727
The value of X at Iteration 81 is -3.4425930153567994
The value of X at Iteration 82 is -3.4737411550496633
The value of X at Iteration 83 is -3.50426633194867
The value of X at Iteration 84 is -3.534181005309697
The value of X at Iteration 85 is -3.563497385203503
The value of X at Iteration 86 is -3.5922274374994325
The value of X at Iteration 87 is -3.620382888749444
The value of X at Iteration 88 is -3.6479752309744553
The value of X at Iteration 89 is -3.675015726354966
The value of X at Iteration 90 is -3.7015154118278666
The value of X at Iteration 91 is -3.7274851035913095
The value of X at Iteration 92 is -3.7529354015194833
The value of X at Iteration 93 is -3.7778766934890937
The value of X at Iteration 94 is -3.8023191596193118
The value of X at Iteration 95 is -3.8262727764269258
The value of X at Iteration 96 is -3.8497473208983872
The value of X at Iteration 97 is -3.8727523744804193
The value of X at Iteration 98 is -3.895297326990811
The value of X at Iteration 99 is -3.917391380450995
The value of X at Iteration 100 is -3.939043552841975
The value of X at Iteration 101 is -3.9602626817851356
The value of X at Iteration 102 is -3.981057428149433
The value of X at Iteration 103 is -4.001436279586445
The value of X at Iteration 104 is -4.021407553994716
The value of X at Iteration 105 is -4.040979402914822
The value of X at Iteration 106 is -4.060159814856525
The value of X at Iteration 107 is -4.078956618559395
The value of X at Iteration 108 is -4.097377486188207
The value of X at Iteration 109 is -4.115429936464443
The value of X at Iteration 110 is -4.133121337735154
The value of X at Iteration 111 is -4.150458910980451
The value of X at Iteration 112 is -4.167449732760842
The value of X at Iteration 113 is -4.1841007381056246
The value of X at Iteration 114 is -4.200418723343512
The value of X at Iteration 115 is -4.216410348876642
The value of X at Iteration 116 is -4.2320821418991095
The value of X at Iteration 117 is -4.247440499061128
The value of X at Iteration 118 is -4.262491689079905
The value of X at Iteration 119 is -4.277241855298307
The value of X at Iteration 120 is -4.291697018192341
The value of X at Iteration 121 is -4.305863077828494
The value of X at Iteration 122 is -4.319745816271924
The value of X at Iteration 123 is -4.333350899946486
The value of X at Iteration 124 is -4.3466838819475555
The value of X at Iteration 125 is -4.359750204308605
The value of X at Iteration 126 is -4.372555200222433
The value of X at Iteration 127 is -4.385104096217984
The value of X at Iteration 128 is -4.3974020142936245
The value of X at Iteration 129 is -4.409453974007752
The value of X at Iteration 130 is -4.421264894527597
The value of X at Iteration 131 is -4.432839596637045
The value of X at Iteration 132 is -4.444182804704305
The value of X at Iteration 133 is -4.4552991486102185
The value of X at Iteration 134 is -4.466193165638014
The value of X at Iteration 135 is -4.4768693023252535
The value of X at Iteration 136 is -4.487331916278748
The value of X at Iteration 137 is -4.497585277953173
The value of X at Iteration 138 is -4.50763357239411
The value of X at Iteration 139 is -4.517480900946228
The value of X at Iteration 140 is -4.527131282927304
The value of X at Iteration 141 is -4.536588657268758
The value of X at Iteration 142 is -4.545856884123382
The value of X at Iteration 143 is -4.5549397464409145
The value of X at Iteration 144 is -4.563840951512097
The value of X at Iteration 145 is -4.572564132481855
The value of X at Iteration 146 is -4.581112849832218
The value of X at Iteration 147 is -4.589490592835574
The value of X at Iteration 148 is -4.597700780978863
The value of X at Iteration 149 is -4.605746765359285
The value of X at Iteration 150 is -4.6136318300521
The value of X at Iteration 151 is -4.621359193451058
The value of X at Iteration 152 is -4.628932009582036
The value of X at Iteration 153 is -4.636353369390395
The value of X at Iteration 154 is -4.643626302002588
The value of X at Iteration 155 is -4.650753775962536
The value of X at Iteration 156 is -4.657738700443285
The value of X at Iteration 157 is -4.664583926434419
The value of X at Iteration 158 is -4.671292247905731
The value of X at Iteration 159 is -4.6778664029476165
The value of X at Iteration 160 is -4.684309074888664
The value of X at Iteration 161 is -4.6906228933908904
The value of X at Iteration 162 is -4.696810435523073
The value of X at Iteration 163 is -4.702874226812612
The value of X at Iteration 164 is -4.708816742276359
The value of X at Iteration 165 is -4.714640407430832
The value of X at Iteration 166 is -4.720347599282215
The value of X at Iteration 167 is -4.725940647296571
The value of X at Iteration 168 is -4.731421834350639
The value of X at Iteration 169 is -4.736793397663627
The value of X at Iteration 170 is -4.742057529710355
The value of X at Iteration 171 is -4.747216379116147
The value of X at Iteration 172 is -4.752272051533824
The value of X at Iteration 173 is -4.757226610503148
The value of X at Iteration 174 is -4.762082078293084
The value of X at Iteration 175 is -4.766840436727223
The value of X at Iteration 176 is -4.771503627992678
The value of X at Iteration 177 is -4.776073555432824
The value of X at Iteration 178 is -4.780552084324168
The value of X at Iteration 179 is -4.784941042637685
The value of X at Iteration 180 is -4.7892422217849315
The value of X at Iteration 181 is -4.793457377349233
The value of X at Iteration 182 is -4.7975882298022485
The value of X at Iteration 183 is -4.801636465206204
The value of X at Iteration 184 is -4.805603735902079
The value of X at Iteration 185 is -4.809491661184038
The value of X at Iteration 186 is -4.813301827960357
The value of X at Iteration 187 is -4.81703579140115
The value of X at Iteration 188 is -4.820695075573127
The value of X at Iteration 189 is -4.824281174061665
The value of X at Iteration 190 is -4.827795550580431
The value of X at Iteration 191 is -4.831239639568823
The value of X at Iteration 192 is -4.834614846777447
The value of X at Iteration 193 is -4.837922549841898
The value of X at Iteration 194 is -4.84116409884506
The value of X at Iteration 195 is -4.844340816868159
The value of X at Iteration 196 is -4.847454000530796
The value of X at Iteration 197 is -4.85050492052018
The value of X at Iteration 198 is -4.853494822109776
The value of X at Iteration 199 is -4.85642492566758
The value of X at Iteration 200 is -4.859296427154229
The value of X at Iteration 201 is -4.862110498611145
The value of X at Iteration 202 is -4.864868288638922
The value of X at Iteration 203 is -4.867570922866143
The value of X at Iteration 204 is -4.87021950440882
The value of X at Iteration 205 is -4.872815114320644
The value of X at Iteration 206 is -4.875358812034231
The value of X at Iteration 207 is -4.877851635793546
The value of X at Iteration 208 is -4.880294603077676
The value of X at Iteration 209 is -4.882688711016122
The value of X at Iteration 210 is -4.8850349367958
The value of X at Iteration 211 is -4.887334238059884
The value of X at Iteration 212 is -4.8895875532986866
The value of X at Iteration 213 is -4.891795802232712
The value of X at Iteration 214 is -4.893959886188058
The value of X at Iteration 215 is -4.896080688464297
The value of X at Iteration 216 is -4.898159074695011
The value of X at Iteration 217 is -4.9001958932011105
The value of X at Iteration 218 is -4.902191975337089
The value of X at Iteration 219 is -4.904148135830347
The value of X at Iteration 220 is -4.90606517311374
The value of X at Iteration 221 is -4.907943869651465
The value of X at Iteration 222 is -4.909784992258436
The value of X at Iteration 223 is -4.911589292413267
The value of X at Iteration 224 is -4.913357506565002
The value of X at Iteration 225 is -4.915090356433702
The value of X at Iteration 226 is -4.9167885493050285
The value of X at Iteration 227 is -4.918452778318928
The value of X at Iteration 228 is -4.920083722752549
The value of X at Iteration 229 is -4.921682048297498
The value of X at Iteration 230 is -4.923248407331548
The value of X at Iteration 231 is -4.9247834391849175
The value of X at Iteration 232 is -4.926287770401219
The value of X at Iteration 233 is -4.927762014993195
The value of X at Iteration 234 is -4.929206774693331
The value of X at Iteration 235 is -4.930622639199464
The value of X at Iteration 236 is -4.932010186415474
The value of X at Iteration 237 is -4.933369982687164
The value of X at Iteration 238 is -4.934702583033421
The value of X at Iteration 239 is -4.936008531372753
The value of X at Iteration 240 is -4.937288360745298
The value of X at Iteration 241 is -4.938542593530392
The value of X at Iteration 242 is -4.939771741659784
The value of X at Iteration 243 is -4.940976306826588
The value of X at Iteration 244 is -4.942156780690056
The value of X at Iteration 245 is -4.943313645076255
The value of X at Iteration 246 is -4.94444737217473
The value of X at Iteration 247 is -4.945558424731236
The value of X at Iteration 248 is -4.946647256236611
The value of X at Iteration 249 is -4.947714311111879
The value of X at Iteration 250 is -4.9487600248896415
The value of X at Iteration 251 is -4.949784824391848
The value of X at Iteration 252 is -4.950789127904011
The value of X at Iteration 253 is -4.951773345345931
The value of X at Iteration 254 is -4.952737878439012
The value of X at Iteration 255 is -4.953683120870232
The value of X at Iteration 256 is -4.954609458452827
The value of X at Iteration 257 is -4.955517269283771
The value of X at Iteration 258 is -4.956406923898095
The value of X at Iteration 259 is -4.957278785420133
The value of X at Iteration 260 is -4.958133209711731
The value of X at Iteration 261 is -4.958970545517496
The value of X at Iteration 262 is -4.959791134607146
The value of X at Iteration 263 is -4.960595311915003
The value of X at Iteration 264 is -4.9613834056767026
The value of X at Iteration 265 is -4.962155737563169
The value of X at Iteration 266 is -4.962912622811905
The value of X at Iteration 267 is -4.963654370355667
The value of X at Iteration 268 is -4.964381282948554
The value of X at Iteration 269 is -4.965093657289583
The value of X at Iteration 270 is -4.965791784143791
The value of X at Iteration 271 is -4.966475948460915
The value of X at Iteration 272 is -4.967146429491697
The value of X at Iteration 273 is -4.967803500901863
The value of X at Iteration 274 is -4.968447430883826
The value of X at Iteration 275 is -4.969078482266149
The value of X at Iteration 276 is -4.969696912620826
The value of X at Iteration 277 is -4.970302974368409
The value of X at Iteration 278 is -4.970896914881041
The value of X at Iteration 279 is -4.97147897658342
The value of X at Iteration 280 is -4.972049397051752
The value of X at Iteration 281 is -4.972608409110717
The value of X at Iteration 282 is -4.973156240928502
The value of X at Iteration 283 is -4.973693116109932
The value of X at Iteration 284 is -4.974219253787734
The value of X at Iteration 285 is -4.974734868711979
The value of X at Iteration 286 is -4.975240171337739
The value of X at Iteration 287 is -4.975735367910985
The value of X at Iteration 288 is -4.976220660552765
The value of X at Iteration 289 is -4.976696247341709
The value of X at Iteration 290 is -4.977162322394875
The value of X at Iteration 291 is -4.977619075946977
The value of X at Iteration 292 is -4.978066694428038
The value of X at Iteration 293 is -4.978505360539477
The value of X at Iteration 294 is -4.978935253328687
The value of X at Iteration 295 is -4.979356548262113
The value of X at Iteration 296 is -4.979769417296871
The value of X at Iteration 297 is -4.980174028950934
The value of X at Iteration 298 is -4.980570548371915
The value of X at Iteration 299 is -4.980959137404477
The value of X at Iteration 300 is -4.981339954656387
The value of X at Iteration 301 is -4.981713155563259
The value of X at Iteration 302 is -4.982078892451994
The value of X at Iteration 303 is -4.9824373146029535
The value of X at Iteration 304 is -4.982788568310895
The value of X at Iteration 305 is -4.983132796944677
The value of X at Iteration 306 is -4.983470141005784
The value of X at Iteration 307 is -4.983800738185668
The value of X at Iteration 308 is -4.984124723421955
The value of X at Iteration 309 is -4.984442228953515
The value of X at Iteration 310 is -4.984753384374445
The value of X at Iteration 311 is -4.985058316686956
The value of X at Iteration 312 is -4.9853571503532175
The value of X at Iteration 313 is -4.985650007346153
The value of X at Iteration 314 is -4.9859370071992295
The value of X at Iteration 315 is -4.986218267055245
The value of X at Iteration 316 is -4.98649390171414
The value of X at Iteration 317 is -4.986764023679857
The value of X at Iteration 318 is -4.98702874320626
The value of X at Iteration 319 is -4.987288168342134
The value of X at Iteration 320 is -4.987542404975292
The value of X at Iteration 321 is -4.987791556875786
The value of X at Iteration 322 is -4.98803572573827
The value of X at Iteration 323 is -4.988275011223505
The value of X at Iteration 324 is -4.988509510999035
The value of X at Iteration 325 is -4.988739320779054
The value of X at Iteration 326 is -4.988964534363473
The value of X at Iteration 327 is -4.989185243676204
The value of X at Iteration 328 is -4.98940153880268
The value of X at Iteration 329 is -4.989613508026626
The value of X at Iteration 330 is -4.989821237866094
The value of X at Iteration 331 is -4.990024813108772
The value of X at Iteration 332 is -4.9902243168465965
The value of X at Iteration 333 is -4.990419830509665
The value of X at Iteration 334 is -4.990611433899471
The value of X at Iteration 335 is -4.990799205221482
The value of X at Iteration 336 is -4.990983221117052
The value of X at Iteration 337 is -4.991163556694711
The value of X at Iteration 338 is -4.991340285560817
The value of X at Iteration 339 is -4.9915134798496
The value of X at Iteration 340 is -4.991683210252608
The value of X at Iteration 341 is -4.991849546047556
The value of X at Iteration 342 is -4.992012555126605
The value of X at Iteration 343 is -4.992172304024073
The value of X at Iteration 344 is -4.992328857943591
The value of X at Iteration 345 is -4.99248228078472
The value of X at Iteration 346 is -4.992632635169025
The value of X at Iteration 347 is -4.9927799824656445
The value of X at Iteration 348 is -4.992924382816332
The value of X at Iteration 349 is -4.993065895160005
The value of X at Iteration 350 is -4.993204577256805
The value of X at Iteration 351 is -4.993340485711669
The value of X at Iteration 352 is -4.993473675997436
The value of X at Iteration 353 is -4.993604202477487
The value of X at Iteration 354 is -4.993732118427937
The value of X at Iteration 355 is -4.993857476059379
The value of X at Iteration 356 is -4.993980326538191
The value of X at Iteration 357 is -4.9941007200074266
The value of X at Iteration 358 is -4.994218705607278
The value of X at Iteration 359 is -4.994334331495133
The value of X at Iteration 360 is -4.994447644865231
The value of X at Iteration 361 is -4.994558691967926
The value of X at Iteration 362 is -4.994667518128567
The value of X at Iteration 363 is -4.994774167765996
The value of X at Iteration 364 is -4.9948786844106765
The value of X at Iteration 365 is -4.994981110722463
The value of X at Iteration 366 is -4.995081488508014
The value of X at Iteration 367 is -4.995179858737854
The value of X at Iteration 368 is -4.995276261563097
The value of X at Iteration 369 is -4.995370736331835
The value of X at Iteration 370 is -4.9954633216051985
The value of X at Iteration 371 is -4.995554055173095
The value of X at Iteration 372 is -4.995642974069633
The value of X at Iteration 373 is -4.99573011458824
The value of X at Iteration 374 is -4.995815512296476
The value of X at Iteration 375 is -4.995899202050547
The value of X at Iteration 376 is -4.995981218009535
The value of X at Iteration 377 is -4.996061593649345
The value of X at Iteration 378 is -4.996140361776358
The value of X at Iteration 379 is -4.996217554540831
The value of X at Iteration 380 is -4.996293203450014
The value of X at Iteration 381 is -4.996367339381013
The value of X at Iteration 382 is -4.996439992593393
The value of X at Iteration 383 is -4.996511192741525
The value of X at Iteration 384 is -4.996580968886694
The value of X at Iteration 385 is -4.99664934950896
The value of X at Iteration 386 is -4.9967163625187805
The value of X at Iteration 387 is -4.996782035268405
The value of X at Iteration 388 is -4.996846394563037
The value of X at Iteration 389 is -4.996909466671776
The value of X at Iteration 390 is -4.996971277338341
The value of X at Iteration 391 is -4.997031851791574
The value of X at Iteration 392 is -4.997091214755742
The value of X at Iteration 393 is -4.997149390460628
The value of X at Iteration 394 is -4.997206402651415
The value of X at Iteration 395 is -4.997262274598387
The value of X at Iteration 396 is -4.997317029106419
The value of X at Iteration 397 is -4.997370688524291
The value of X at Iteration 398 is -4.997423274753805
The value of X at Iteration 399 is -4.997474809258729
The value of X at Iteration 400 is -4.997525313073554
The value of X at Iteration 401 is -4.997574806812083
The value of X at Iteration 402 is -4.997623310675841
The value of X at Iteration 403 is -4.997670844462324
The value of X at Iteration 404 is -4.997717427573078
The value of X at Iteration 405 is -4.997763079021617
The value of X at Iteration 406 is -4.997807817441185
The value of X at Iteration 407 is -4.997851661092361
The value of X at Iteration 408 is -4.997894627870514
The value of X at Iteration 409 is -4.997936735313104
The value of X at Iteration 410 is -4.9979780006068415
The value of X at Iteration 411 is -4.998018440594705
The value of X at Iteration 412 is -4.998058071782811
The value of X at Iteration 413 is -4.998096910347155
The value of X at Iteration 414 is -4.998134972140212
The value of X at Iteration 415 is -4.998172272697408
The value of X at Iteration 416 is -4.9982088272434595
The value of X at Iteration 417 is -4.998244650698591
The value of X at Iteration 418 is -4.998279757684619
The value of X at Iteration 419 is -4.998314162530927
The value of X at Iteration 420 is -4.998347879280309
The value of X at Iteration 421 is -4.998380921694703
The value of X at Iteration 422 is -4.998413303260809
The value of X at Iteration 423 is -4.998445037195593
The value of X at Iteration 424 is -4.998476136451681
The value of X at Iteration 425 is -4.998506613722648
The value of X at Iteration 426 is -4.998536481448195
The value of X at Iteration 427 is -4.998565751819231
The value of X at Iteration 428 is -4.998594436782846
The value of X at Iteration 429 is -4.998622548047189
The value of X at Iteration 430 is -4.998650097086245
The value of X at Iteration 431 is -4.9986770951445205
The value of X at Iteration 432 is -4.99870355324163
The value of X at Iteration 433 is -4.998729482176797
The value of X at Iteration 434 is -4.998754892533261
The value of X at Iteration 435 is -4.998779794682596
The value of X at Iteration 436 is -4.998804198788944
The value of X at Iteration 437 is -4.998828114813166
The value of X at Iteration 438 is -4.998851552516903
The value of X at Iteration 439 is -4.998874521466565
The value of X at Iteration 440 is -4.998897031037234
The value of X at Iteration 441 is -4.998919090416489
The value of X at Iteration 442 is -4.99894070860816
The value of X at Iteration 443 is -4.998961894435997
The value of X at Iteration 444 is -4.998982656547277
The value of X at Iteration 445 is -4.999003003416331
The value of X at Iteration 446 is -4.999022943348004
The value of X at Iteration 447 is -4.999042484481044
The value of X at Iteration 448 is -4.999061634791423
The value of X at Iteration 449 is -4.999080402095594
The value of X at Iteration 450 is -4.999098794053682
The value of X at Iteration 451 is -4.999116818172609
The value of X at Iteration 452 is -4.999134481809157
The value of X at Iteration 453 is -4.999151792172974
The value of X at Iteration 454 is -4.999168756329515
The value of X at Iteration 455 is -4.999185381202924
The value of X at Iteration 456 is -4.999201673578866
The value of X at Iteration 457 is -4.999217640107289
The value of X at Iteration 458 is -4.999233287305143
The value of X at Iteration 459 is -4.9992486215590395
The value of X at Iteration 460 is -4.999263649127859
The value of X at Iteration 461 is -4.999278376145302
The value of X at Iteration 462 is -4.999292808622396
The value of X at Iteration 463 is -4.999306952449948
The value of X at Iteration 464 is -4.999320813400949
The value of X at Iteration 465 is -4.99933439713293
The value of X at Iteration 466 is -4.999347709190272
The value of X at Iteration 467 is -4.9993607550064665
The value of X at Iteration 468 is -4.999373539906337
The value of X at Iteration 469 is -4.99938606910821
The value of X at Iteration 470 is -4.9993983477260455
The value of X at Iteration 471 is -4.999410380771525
The value of X at Iteration 472 is -4.999422173156094
The value of X at Iteration 473 is -4.9994337296929725
The value of X at Iteration 474 is -4.999445055099113
The value of X at Iteration 475 is -4.999456153997131
The value of X at Iteration 476 is -4.999467030917188
The value of X at Iteration 477 is -4.9994776902988445
The value of X at Iteration 478 is -4.999488136492867
The value of X at Iteration 479 is -4.99949837376301
The value of X at Iteration 480 is -4.99950840628775
The value of X at Iteration 481 is -4.999518238161995
The value of X at Iteration 482 is -4.999527873398756
The value of X at Iteration 483 is -4.99953731593078
The value of X at Iteration 484 is -4.999546569612165
The value of X at Iteration 485 is -4.999555638219921
The value of X at Iteration 486 is -4.999564525455523
The value of X at Iteration 487 is -4.999573234946412
The value of X at Iteration 488 is -4.9995817702474845
The value of X at Iteration 489 is -4.999590134842535
The value of X at Iteration 490 is -4.999598332145684
The value of X at Iteration 491 is -4.99960636550277
The value of X at Iteration 492 is -4.999614238192715
The value of X at Iteration 493 is -4.999621953428861
The value of X at Iteration 494 is -4.999629514360284
The value of X at Iteration 495 is -4.999636924073078
The value of X at Iteration 496 is -4.999644185591617
The value of X at Iteration 497 is -4.999651301879784
The value of X at Iteration 498 is -4.999658275842188
The value of X at Iteration 499 is -4.999665110325345
The value of X at Iteration 500 is -4.999671808118838
The value of X at Iteration 501 is -4.9996783719564615
The value of X at Iteration 502 is -4.999684804517332
The value of X at Iteration 503 is -4.999691108426985
The value of X at Iteration 504 is -4.999697286258446
The value of X at Iteration 505 is -4.9997033405332765
The value of X at Iteration 506 is -4.999709273722611
The value of X at Iteration 507 is -4.999715088248159
The value of X at Iteration 508 is -4.999720786483196
The value of X at Iteration 509 is -4.999726370753532
The value of X at Iteration 510 is -4.999731843338461
The value of X at Iteration 511 is -4.999737206471692
The value of X at Iteration 512 is -4.999742462342258
The value of X at Iteration 513 is -4.999747613095413
The value of X at Iteration 514 is -4.999752660833504
The value of X at Iteration 515 is -4.999757607616834
The value of X at Iteration 516 is -4.999762455464498
The value of X at Iteration 517 is -4.999767206355208
The value of X at Iteration 518 is -4.999771862228104
The value of X at Iteration 519 is -4.999776424983542
The value of X at Iteration 520 is -4.9997808964838715
The value of X at Iteration 521 is -4.999785278554194
The value of X at Iteration 522 is -4.9997895729831106
The value of X at Iteration 523 is -4.999793781523448
The value of X at Iteration 524 is -4.999797905892979
The value of X at Iteration 525 is -4.999801947775119
The value of X at Iteration 526 is -4.999805908819617
The value of X at Iteration 527 is -4.999809790643225
The value of X at Iteration 528 is -4.99981359483036
The value of X at Iteration 529 is -4.999817322933753
The value of X at Iteration 530 is -4.999820976475077
The value of X at Iteration 531 is -4.999824556945576
The value of X at Iteration 532 is -4.999828065806665
The value of X at Iteration 533 is -4.9998315044905315
The value of X at Iteration 534 is -4.999834874400721
The value of X at Iteration 535 is -4.999838176912706
The value of X at Iteration 536 is -4.999841413374452
The value of X at Iteration 537 is -4.999844585106963
The value of X at Iteration 538 is -4.999847693404824
The value of X at Iteration 539 is -4.999850739536727
The value of X at Iteration 540 is -4.999853724745993
The value of X at Iteration 541 is -4.999856650251073
The value of X at Iteration 542 is -4.999859517246051
The value of X at Iteration 543 is -4.99986232690113
The value of X at Iteration 544 is -4.999865080363108
The value of X at Iteration 545 is -4.999867778755846
The value of X at Iteration 546 is -4.999870423180729
The value of X at Iteration 547 is -4.999873014717115
The value of X at Iteration 548 is -4.999875554422772
The value of X at Iteration 549 is -4.999878043334316
The value of X at Iteration 550 is -4.99988048246763
The value of X at Iteration 551 is -4.999882872818278
The value of X at Iteration 552 is -4.999885215361912
The value of X at Iteration 553 is -4.999887511054674
The value of X at Iteration 554 is -4.999889760833581
The value of X at Iteration 555 is -4.999891965616909
The value of X at Iteration 556 is -4.999894126304571
The value of X at Iteration 557 is -4.999896243778479
The value of X at Iteration 558 is -4.999898318902909
The value of X at Iteration 559 is -4.999900352524851
The value of X at Iteration 560 is -4.9999023454743545
The value of X at Iteration 561 is -4.999904298564868
The value of X at Iteration 562 is -4.9999062125935705
The value of X at Iteration 563 is -4.999908088341699
The value of X at Iteration 564 is -4.9999099265748645
The value of X at Iteration 565 is -4.999911728043367
The value of X at Iteration 566 is -4.9999134934825
The value of X at Iteration 567 is -4.99991522361285
The value of X at Iteration 568 is -4.999916919140593
The value of X at Iteration 569 is -4.999918580757781
The value of X at Iteration 570 is -4.999920209142625
The value of X at Iteration 571 is -4.999921804959773
The value of X at Iteration 572 is -4.9999233688605775
The value of X at Iteration 573 is -4.999924901483366
The value of X at Iteration 574 is -4.999926403453699
The value of X at Iteration 575 is -4.999927875384625
The value of X at Iteration 576 is -4.999929317876933
The value of X at Iteration 577 is -4.999930731519394
The value of X at Iteration 578 is -4.999932116889006
The value of X at Iteration 579 is -4.999933474551226
The value of X at Iteration 580 is -4.999934805060202
The value of X at Iteration 581 is -4.999936108958998
The value of X at Iteration 582 is -4.999937386779818
The value of X at Iteration 583 is -4.999938639044221
The value of X at Iteration 584 is -4.999939866263337
The value of X at Iteration 585 is -4.99994106893807
The value of X at Iteration 586 is -4.999942247559309
The value of X at Iteration 587 is -4.999943402608123
The value of X at Iteration 588 is -4.9999445345559606
The value of X at Iteration 589 is -4.999945643864842
The value of X at Iteration 590 is -4.999946730987545
The value of X at Iteration 591 is -4.999947796367794
The value of X at Iteration 592 is -4.999948840440438
The value of X at Iteration 593 is -4.999949863631629
The value of X at Iteration 594 is -4.999950866358997
The value of X at Iteration 595 is -4.9999518490318176The value of local minima of the loss function:
The local minima occurs at X = -4.9999518490318176
[Finished in 0.6s]