Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix a bug of forward-mode AD when multi-output is needed #1925

Open
wants to merge 188 commits into
base: master
Choose a base branch
from
Open
Changes from 183 commits
Commits
Show all changes
188 commits
Select commit Hold shift + click to select a range
b398241
exchange .ipynb with .py and add a demo document
Jerry-Jzy May 27, 2022
f085616
tiny change
Jerry-Jzy May 27, 2022
21a19e0
tiny change in Heat.py
Jerry-Jzy May 27, 2022
df57b39
tiny change in pinn_forwad.rst
Jerry-Jzy May 27, 2022
a86a54c
add heat.py and heat.rst for Deepxde Docs plan
Jerry-Jzy May 27, 2022
f21d706
add heat.py and heat.rst for Deepxde Docs plan
Jerry-Jzy May 27, 2022
663fcda
tiny change in heat.rst
Jerry-Jzy May 27, 2022
908b6dc
Merge pull request #1 from lululxvi/master
Jerry-Jzy May 27, 2022
8b5b980
Update demo document for lorenz with exogenous input. inverse
Jerry-Jzy May 28, 2022
78af98a
Merge remote-tracking branch 'origin/master'
Jerry-Jzy May 28, 2022
b3e1a9e
Update demo document for lorenz with exogenous input. inverse
Jerry-Jzy May 28, 2022
ac81035
Update demo document for lorenz with exogenous input. inverse
Jerry-Jzy May 28, 2022
4141cac
tiny change in .rst
Jerry-Jzy May 28, 2022
f875020
change .rst name and delete one empty line in pinn_inverse.rst
Jerry-Jzy May 28, 2022
46a8df1
tiny change in pinn_inverse.rst
Jerry-Jzy May 28, 2022
c06657d
tiny change in Lorenz.inverse.forced.rst
Jerry-Jzy May 28, 2022
d5da9f7
fix typo in Lorenz.inverse.forced.rst
Jerry-Jzy May 28, 2022
c1bcb16
fix typo in pinn_inverse.rst and rename lorenz.inverse.forced.rst
Jerry-Jzy May 28, 2022
d89816f
fix typo lorenz.inverse.forced.rst
Jerry-Jzy May 28, 2022
8cee955
some tiny changes in lorenz.inverse.forced.rst
Jerry-Jzy May 28, 2022
1b7ba0d
Merge pull request #2 from lululxvi/master
Jerry-Jzy May 28, 2022
e2e5dca
Merge pull request #3 from lululxvi/master
Jerry-Jzy May 30, 2022
c4e5b48
add deeponet implemented by pytorch
Jerry-Jzy Jun 2, 2022
31235cd
Merge remote-tracking branch 'origin/master'
Jerry-Jzy Jun 2, 2022
86e8f2f
add deeponet implemented by pytorch
Jerry-Jzy Jun 2, 2022
31932a4
tiny changes in deeponet.py and model.py
Jerry-Jzy Jun 3, 2022
4ca1ef0
tiny changes in deeponet.py
Jerry-Jzy Jun 3, 2022
42a80f9
tiny changes in deeponet.py, model.py and __init__.py; and add "Step"…
Jerry-Jzy Jun 3, 2022
8b2b449
Fix problem in model.py
Jerry-Jzy Jun 3, 2022
68b90c0
roll back to no lr decay
Jerry-Jzy Jun 3, 2022
c90661c
roll back model.py to no lr decay
Jerry-Jzy Jun 3, 2022
e2370b7
roll back model.py
Jerry-Jzy Jun 3, 2022
03ed52b
reformat model.py and pytorch/optimizers.py via black
Jerry-Jzy Jun 3, 2022
501b74c
Fix problems
Jerry-Jzy Jun 3, 2022
6810319
more proper way in model.py
Jerry-Jzy Jun 3, 2022
4f5e2a6
update model.py
Jerry-Jzy Jun 3, 2022
9bdaf81
delete trailing newlines
Jerry-Jzy Jun 3, 2022
5fb0228
tiny change in model.py
Jerry-Jzy Jun 3, 2022
67a2c88
Merge pull request #4 from lululxvi/master
Jerry-Jzy Jun 3, 2022
a23d0a7
modify pytorch/optimizers.py to add "Step" lr decay method
Jerry-Jzy Jun 3, 2022
6755256
tiny change in pytorch/optimizers.py
Jerry-Jzy Jun 3, 2022
5ded62c
Fix problems
Jerry-Jzy Jun 3, 2022
7a3df95
tiny changes
Jerry-Jzy Jun 3, 2022
e0031df
Fix problem pytorch/optimizers.py
Jerry-Jzy Jun 3, 2022
5c58932
delete emply lines
Jerry-Jzy Jun 4, 2022
04c01cc
Changes in pytorch/optimizers.py
Jerry-Jzy Jun 4, 2022
363bbd1
Fixed problem when optimizer in ["L-BFGS", "L-BFGS-B"] with learning_…
Jerry-Jzy Jun 4, 2022
9e70479
rename SGD as sgd, RMSprop as rmsprop
Jerry-Jzy Jun 4, 2022
f135384
Fix intend problem
Jerry-Jzy Jun 4, 2022
627a610
delete empty lines
Jerry-Jzy Jun 4, 2022
ba5a304
Merge pull request #5 from lululxvi/master
Jerry-Jzy Jun 4, 2022
5835292
Merge pull request #6 from lululxvi/master
Jerry-Jzy Jun 4, 2022
f78bf51
Merge pull request #7 from lululxvi/master
Jerry-Jzy Jun 5, 2022
7078188
Merge pull request #8 from lululxvi/master
Jerry-Jzy Jun 23, 2022
f2eb4e9
add Pytorch implementation of AdamW optimizer
Jerry-Jzy Jun 23, 2022
0b3fbbe
add Pytorch implementation of regularization
Jerry-Jzy Jun 23, 2022
189f50c
add Pytorch implementation of l2 regularization
Jerry-Jzy Jun 23, 2022
cfd3254
tiny change of pytorch/fnn.py
Jerry-Jzy Jun 23, 2022
348a30e
tiny change of model.py and regularizers.py
Jerry-Jzy Jun 23, 2022
9105054
delete Trailing newlines
Jerry-Jzy Jun 23, 2022
80f2632
Fix problems
Jerry-Jzy Jun 23, 2022
2aba91c
fix problem
Jerry-Jzy Jun 23, 2022
65ad905
Reformat via black.
Jerry-Jzy Jun 23, 2022
4d79150
delete TODO
Jerry-Jzy Jun 23, 2022
10ff987
self.regularizer = regularization
Jerry-Jzy Jun 23, 2022
1986884
Modify regularization, to regularization=regularization, and For L-BF…
Jerry-Jzy Jun 23, 2022
327d51c
doesn't require --> doesn't support
Jerry-Jzy Jun 23, 2022
14fa89f
Merge pull request #9 from lululxvi/master
Jerry-Jzy Jun 23, 2022
d2bca4b
Merge pull request #10 from lululxvi/master
Jerry-Jzy Jun 23, 2022
7c01278
backend Pytorch support MIONetCartesianProd and PODMIONet
Jerry-Jzy Jun 28, 2022
482bb09
Merge pull request #11 from lululxvi/master
Jerry-Jzy Jun 28, 2022
907557a
delete repeated comments"Dot product"
Jerry-Jzy Jun 28, 2022
e1da975
change nn/pytorch/__init__.py
Jerry-Jzy Jun 28, 2022
4c020fb
reformat via black
Jerry-Jzy Jun 28, 2022
9e222c3
change input to inputs
Jerry-Jzy Jun 28, 2022
47f6eaf
fix doc typo
Jerry-Jzy Jun 28, 2022
7ddf1ad
git rm PODMIO
Jerry-Jzy Jun 28, 2022
6cb1bdd
little change in mionet.py
Jerry-Jzy Jun 28, 2022
b5c0b2a
branch1 net --> branch net1
Jerry-Jzy Jun 28, 2022
3543793
y_loc = self.trunk(x_loc)
Jerry-Jzy Jun 28, 2022
2c52479
y_loc = self.trunk(x_loc)
Jerry-Jzy Jun 28, 2022
96e28d6
add trunk_activation:bool to determine whether use activation func in…
Jerry-Jzy Jun 29, 2022
cadeed9
add trunk_last_activation:bool to determine whether use activation fu…
Jerry-Jzy Jun 29, 2022
16ca440
fix problems
Jerry-Jzy Jun 29, 2022
7fafb08
fix problem in pytorch/mionet.py
Jerry-Jzy Jun 29, 2022
8ae11fd
fix problem in pytorch/mionet.py
Jerry-Jzy Jun 29, 2022
71e72cf
Merge pull request #12 from lululxvi/master
Jerry-Jzy Jun 29, 2022
4537214
fix problem in pytorch/mionet.py
Jerry-Jzy Jun 29, 2022
f525aa6
Merge pull request #13 from lululxvi/master
Jerry-Jzy Jul 6, 2022
be48df7
Merge pull request #14 from lululxvi/master
Jerry-Jzy Jul 31, 2022
96b2857
pytorch backend PODMIONet add branch connect method of "sum","mul","c…
Jerry-Jzy Jul 31, 2022
5ad1eeb
change port net-->merge net
Jerry-Jzy Jul 31, 2022
bf826c6
change merge net-->merger net
Jerry-Jzy Jul 31, 2022
e397040
change connect_method-->merge_operation
Jerry-Jzy Jul 31, 2022
94017e2
black reformat
Jerry-Jzy Jul 31, 2022
e2be87c
move merge_operation="mul" to second last
Jerry-Jzy Jul 31, 2022
e9e4039
Merge pull request #15 from lululxvi/master
Jerry-Jzy Aug 15, 2022
a93fdcd
add merger net and output merger net in MIONetCartesianProd and add m…
Jerry-Jzy Aug 15, 2022
d2f34d0
fix problems in callbacks.py
Jerry-Jzy Aug 15, 2022
3fc4b1e
recover mionet.py
Jerry-Jzy Aug 15, 2022
1644386
fix problems
Jerry-Jzy Aug 15, 2022
59ffb46
fix problem
Jerry-Jzy Aug 15, 2022
218aa61
Merge pull request #16 from lululxvi/master
Jerry-Jzy Aug 15, 2022
e65b392
Add merger net and ouput merger net in MIONetCartesianProd
Jerry-Jzy Aug 15, 2022
8ddb300
fix problem
Jerry-Jzy Aug 15, 2022
944e929
Merge pull request #17 from lululxvi/master
Jerry-Jzy Aug 15, 2022
4b5f322
change sum operation to add operation
Jerry-Jzy Aug 26, 2022
5d9c7f3
Merge pull request #18 from lululxvi/master
Jerry-Jzy Aug 26, 2022
f678cfd
Merge pull request #19 from lululxvi/master
Jerry-Jzy Sep 10, 2022
bc4304f
Fix bug in pytorch backended mionet
Jerry-Jzy Sep 10, 2022
15c46db
Merge pull request #20 from lululxvi/master
Jerry-Jzy Sep 10, 2022
1ce13f4
Merge pull request #21 from lululxvi/master
Jerry-Jzy Sep 22, 2022
902f787
Merge pull request #22 from lululxvi/master
Jerry-Jzy Oct 22, 2022
482f40f
add minibatch
Jerry-Jzy Oct 22, 2022
72f412b
fix bug
Jerry-Jzy Oct 22, 2022
affc5ca
add minibatch
Jerry-Jzy Oct 22, 2022
6544048
fix bug
Jerry-Jzy Oct 22, 2022
94c7f51
update docstring
Jerry-Jzy Oct 22, 2022
663af65
fix bug
Jerry-Jzy Oct 22, 2022
0cd00d0
update docstring
Jerry-Jzy Oct 22, 2022
35efc65
update
Jerry-Jzy Oct 22, 2022
321b8a9
update docstring
Jerry-Jzy Oct 22, 2022
6d24a0c
update
Jerry-Jzy Oct 22, 2022
71af042
update docstring
Jerry-Jzy Oct 22, 2022
d6c3cb9
update docstring
Jerry-Jzy Oct 22, 2022
35158bc
update docstring
Jerry-Jzy Oct 22, 2022
2542646
update docstring
Jerry-Jzy Oct 22, 2022
d743f04
update docstring
Jerry-Jzy Oct 22, 2022
1aee36f
update docstring
Jerry-Jzy Oct 22, 2022
57a2e55
update docstring
Jerry-Jzy Oct 22, 2022
b7f07e8
update docstring
Jerry-Jzy Oct 22, 2022
1f94994
update docstring
Jerry-Jzy Oct 22, 2022
d6b81a1
update docstring
Jerry-Jzy Oct 22, 2022
a8bfe61
update docstring
Jerry-Jzy Oct 22, 2022
1c17fd9
update docstring
Jerry-Jzy Oct 22, 2022
0ff3642
update docstring
Jerry-Jzy Oct 22, 2022
94ba9e2
update docstring
Jerry-Jzy Oct 22, 2022
b05809c
Merge pull request #23 from lululxvi/master
Jerry-Jzy Oct 22, 2022
21c7c55
Merge pull request #24 from lululxvi/master
Jerry-Jzy Nov 10, 2022
dcf2a88
fix bug in Pytorch backend DeepONet
Jerry-Jzy Nov 10, 2022
eeb022b
fix bug in Pytorch backend DeepONet
Jerry-Jzy Nov 10, 2022
82e58a2
Fix merge conflict
Jerry-Jzy Apr 13, 2023
141a6b0
Merge pull request #26 from Jerry-Jzy/lululxvi-master
Jerry-Jzy Apr 13, 2023
198fc3c
Merge pull request #25 from lululxvi/master
Jerry-Jzy Apr 13, 2023
d18fe23
update research.rst
Jerry-Jzy Apr 14, 2023
51b25d3
update index.rst
Jerry-Jzy Apr 14, 2023
3297834
update README.md
Jerry-Jzy Apr 14, 2023
24be4a8
Move Fourier-MIONet after MIONet
Jerry-Jzy Apr 14, 2023
3980dff
update university and industry list
Jerry-Jzy Apr 14, 2023
466a076
Move ExxonMobil after BirenTech Research
Jerry-Jzy Apr 14, 2023
6cadf2f
update university list
Jerry-Jzy Apr 14, 2023
05b91cb
Merge remote-tracking branch 'origin/master'
Jerry-Jzy Dec 1, 2024
8089a23
update pde_operator.py to support forward mode AD
Jerry-Jzy Dec 1, 2024
18ff1c1
fix the bug when multi output needed
Jerry-Jzy Dec 1, 2024
6c258db
add a blank line to fix Codacy Static Code Analysis
Jerry-Jzy Dec 1, 2024
5917be1
Use reverse mode in the if, forward mode in the else.
Jerry-Jzy Dec 2, 2024
2632026
rollback
Jerry-Jzy Dec 8, 2024
07a9d96
add elif config.autodiff == "forward":
Jerry-Jzy Dec 8, 2024
faca8e7
add losses = [] before if-else
Jerry-Jzy Dec 11, 2024
45fecb5
delete empty line
Jerry-Jzy Dec 15, 2024
cf076d9
delete duplicated code
Jerry-Jzy Dec 15, 2024
947abee
Refactor the code to reduce the redundancy
Jerry-Jzy Dec 16, 2024
cead384
add empty line
Jerry-Jzy Dec 16, 2024
68b4fe9
add empty line and change variable names
Jerry-Jzy Dec 16, 2024
c1b3384
polish code
Jerry-Jzy Dec 16, 2024
303066a
fix bug
Jerry-Jzy Dec 16, 2024
4d4106c
Reformat by using black
Jerry-Jzy Dec 16, 2024
e7f2bb1
add comment
Jerry-Jzy Dec 17, 2024
e490963
add comment
Jerry-Jzy Dec 17, 2024
106f13f
delete comment
Jerry-Jzy Dec 18, 2024
bcac97f
modify comment
Jerry-Jzy Dec 18, 2024
420313b
add comment
Jerry-Jzy Dec 18, 2024
292d05e
add comment
Jerry-Jzy Dec 18, 2024
85c8d2e
refactor code of BC loss
Jerry-Jzy Dec 18, 2024
5ef4f4f
modify bc loss code
Jerry-Jzy Dec 18, 2024
66682a4
modify code
Jerry-Jzy Dec 18, 2024
a9a9932
modify code
Jerry-Jzy Dec 23, 2024
fa6e368
add comment
Jerry-Jzy Dec 23, 2024
37f19a4
modify comment
Jerry-Jzy Dec 23, 2024
28716c6
after black
Jerry-Jzy Dec 23, 2024
bd88ec4
change variable name
Jerry-Jzy Dec 23, 2024
9f34ae4
Merge pull request #28 from lululxvi/master
Jerry-Jzy Dec 24, 2024
07f15a5
fix a bug of forward-mode AD when muti-output is needed
Jerry-Jzy Dec 24, 2024
d3579dd
add comment
Jerry-Jzy Dec 24, 2024
00a7be5
add comment
Jerry-Jzy Dec 24, 2024
2f4e340
update comment
Jerry-Jzy Dec 25, 2024
e20364c
update comment, fix a bug and rewrite the computation of dim
Jerry-Jzy Dec 26, 2024
101bc31
update code
Jerry-Jzy Dec 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion deepxde/gradients/gradients_forward.py
Original file line number Diff line number Diff line change
Expand Up @@ -94,7 +94,7 @@ def grad_fn(x):
# which is also a tuple. This is useful for further computation, e.g.,
# Hessian.
self.J[i, j] = (
self.J[j][0][:, i : i + 1],
self.J[j][0][..., i : i + 1],
lululxvi marked this conversation as resolved.
Show resolved Hide resolved
lambda x: self.J[j][1](x)[i : i + 1],
)
return self.J[i, j]
Expand Down
Loading