Tensorflow define a operation that builds the product of all tensor components

Question

I want to define a operation in tensorflow that calculates something like:

x is provided by a tensor. Finally the operation should be compared to a known value and parameters alpha, beta i and b should be learned.

(I guess) The product of all inputs causes trouble. This is one version that I tried to deploy, with no success.
# input
X = tf.placeholder(tf.float32, [None, 2], name="X")
Y = tf.placeholder(tf.float32, [None, 1], name="Y")

# hidden

beta = tf.get_variable("beta", shape=[2], initializer=tf.contrib.layers.xavier_initializer())

powered = tf.pow(X,beta)

productLayer = tf.contrib.keras.layers.multiply(powered) # bad line



# output

w_o = tf.get_variable("w_o", shape=[1], initializer=tf.contrib.layers.xavier_initializer())

b_o = tf.get_variable("bias", shape=[1], initializer=tf.zeros([1]))



output = tf.add(tf.matmul(productLayer,w_o), b_o)

loss = tf.reduce_sum(tf.square(output - Y)) # tf.nn.l2_loss(yhat - Y)

Running the full script from gist
https://gist.github.com/anonymous/c17d45b4e997bfccb5275dffa44512d6
is resulting in the error message:

File "h2o_test_opti.py", line 13, in
productLayer = tf.contrib.keras.layers.multiply(powered) ValueError: A merge layer should be called on a list of inputs.

I thought the functionality describtion of tf.contrib.keras.layers.multiply fits to my needs. I also tried to find a naive way like a for-loop to calculate the product of all incoming tensor-elements, but with no success, as I couldn't imagine a way to access the tensor in a right way. Choosing the correct indicies isn't(?) possible, as I don't know the current step and therefore the right tensor to be treated?

I want to test this as an "activation-function" (properly more as optimization/fitting procedure)

Please let me know if there is more information required to help with this problem.

Recommended for you: Get network issues from WhatsUp Gold. Not end users.

Answer 1

I found an working solution to my idea by changing:

    productLayer = tf.contrib.keras.layers.multiply(powered) # bad line

to:

    productLayer = tf.reshape(tf.reduce_prod(X,1), (-1,1))

It should work. Maybe someone can use this too.

Tensorflow define a operation that builds the product of all tensor components

Sign up