Train Neural Network
Posted 12 July 2004 - 11:53 AM
I have a 3-layer neural network (input, hidden, output) using sigmoid functions.
I can train the network to learn the xor function perfectly.
However when i try to train the network to learn the sine function it fails.
The train dataset is [41 rows x 2 columns] array.
The values in first column run from -1 to +1 and the its corresponding sine values are stored in the second column.
The network error remains the same (around 0.5) no matter how many iterations i run.
Anyone have a idea what is wrong with the network?
Thank you in advance.... really waiting for your feedback....
Posted 12 July 2004 - 05:51 PM
Posted 13 July 2004 - 12:54 AM
Thank you for ur reply.
Well I did try but it still not working...After trying to change the parameters, i found out the with the train dataset other than the train dataset i used for training the xor function (matrix of 4x2) the network fails.
Do you have any idea what should be the problem?
Posted 13 July 2004 - 01:52 AM
Now the problem is: cannot train negative values... and the network error can not go below 0.04...
I did try to change the number of neurons, the learning rate, the momentum but still cannot go below 0.04...
Anyone have an idea....
Any feedback will be very much appreciated....
Posted 13 July 2004 - 06:41 AM
i can't think of any typical error right now and small errors in your code can cause havok in the network
Posted 13 July 2004 - 02:05 PM
I modified the code and put here
Could you have a look?
Thank you very much
Posted 13 July 2004 - 03:07 PM
Posted 16 July 2004 - 06:58 PM
OK, please give me some idea on these:
*the smallest network error when training sine function is around 0.04, when training function 1/x^2 is around 0.01....no matter how many time i set the number of iteration... Why is this so? is true that the more the number of iteration the smaller the network error? i use mean square error.
*the error is not just going down...it's up and down, very unstable...
Thank you very much...
Posted 16 July 2004 - 07:48 PM
Posted 20 July 2004 - 06:55 PM
Posted 20 July 2004 - 09:19 PM
read up a bit on n-networks and you will understand my rather simple example
1 user(s) are reading this topic
0 members, 1 guests, 0 anonymous users