{"id":226,"date":"2021-02-17T02:54:31","date_gmt":"2021-02-17T02:54:31","guid":{"rendered":"http:\/\/enriquegortiz.com\/wordpress\/enriquegortiz-staging\/?post_type=fw-portfolio&p=226"},"modified":"2022-12-18T19:06:22","modified_gmt":"2022-12-18T19:06:22","slug":"parent-offspring-resemblance","status":"publish","type":"fw-portfolio","link":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/project\/parent-offspring-resemblance\/","title":{"rendered":"Parent-Offspring Resemblance"},"content":{"rendered":"
\n\t
\n\t\t
\n\t\r\n\r\n
\r\n
\r\n\t\t

A. Dehghan<\/a>,\u00a0E.<\/a>G. Ortiz<\/a><\/strong>,\u00a0R. Villegas, and M. Shah<\/a>. \u00a0\"Who Do I Look Like? Determining Parent-Offspring Resemblance via Gated Autoencoders\"<\/a>.<\/em>\u00a0IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. [pdf<\/a>]<\/p>

Who's Your Daddy?<\/h1>

Motivation<\/h1>

\"\"<\/p>

In this project, our goal is to bridge computer vision research with findings in anthropological studies to answer several key questions:<\/p>

  1. Do offspring resemble their parents?<\/li>
  2. Do offspring resemble one parent more than the other?<\/li>
  3. What parts of the face are more genetic?<\/li>
  4. Do anthropologies' studies help learn better features?<\/li><\/ol>

    To answer these questions and address the problem of parent-offspring resemblance we propose an algorithm that fuses the features and metrics discovered via gated autoencoders with a discriminative neural network layer that learns the optimal, or what we call genetic, features for the task.<\/p>

    Gated Autoencoder<\/h1>

    \"\"<\/p>

     <\/p>

    In the core of our framework lies a gated autoencoder, which describes the relationship between a pair of images. The inpusts to the gated autoencoder are patches extracted from a pair of parent-offspring images (after alignment), as shown in the figure. The transformation between patches are encoded in the new variable called z, <\/i>and the corresponding filters are learnt by minimizing the following loss function.<\/p>

    <\/p>

    \\(L_{gen}=\\sum^N_{n=1}\\|y^{'(n)}-y^{(n)}\\|^2 + \\sum^N_{n=1}\\|x^{'(n)}-x^{(n)}\\|^2\\)<\/p>

    We further add a discriminative layer on the top of gated autoencoder to distinguish between related and non-related pair of images. The loss function for the discriminative layer is shown below, in which we try to minimize the error between predicted labels and groundtruth labels.<\/p>

    \\(L_{disc}=\\sum^N_{n=1}\\|softmax(T(z^{n}))-GT^{(n)}\\|_1\\)<\/p>

    Results<\/h1>

    \"\"In our experimentation, we look at metric learning methods that only learn a metric whereas we learn both an optimal feature mapping and metric for parent-offspring resemblance. We also looked at t<\/span>hree setups, 1) Generative - which only uses the gated autoencoder without metric layer, 2) Anthropological - which uses weighting based on the most genetically meaningful features from anthropological studies, and 3) Discriminative - which learns both the best feature mapping and metric automatically. As shown in the table, we found that our discriminative method outperforms anthropological weights by ~2% and the best performing metric learner by ~3% on the popular kinship verification dataset KinFaceW-I<\/a>.<\/span><\/p>

    Our method, however, is most ideally suited for the task of face identification, where we do not want to simply tell whether two images are of the same family, but find an offsprings match in a large pool of parents. For this task, we use the Family 101<\/a>\u00a0dataset as shown below. In our experimentation, we found that our method performs better than chance on parent-offspring for most relationships at low rank, but the father-son relationship does slightly worse as the rank increases.<\/p>

    \"\"<\/p>

    Publicity<\/h1>

    UCF Today<\/a>\u00a0| Fox Orlando<\/a><\/p>

    https:\/\/www.youtube.com\/watch?v=y0_DzOv8VfY<\/p>\t<\/div>\r\n<\/div>\r\n<\/div>\n\n\t<\/div>\n<\/section>\n\n","protected":false},"featured_media":234,"template":"","fw-portfolio-category":[33],"class_list":["post-226","fw-portfolio","type-fw-portfolio","status-publish","has-post-thumbnail","hentry","fw-portfolio-category-research"],"_links":{"self":[{"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/fw-portfolio\/226","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/fw-portfolio"}],"about":[{"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/types\/fw-portfolio"}],"version-history":[{"count":5,"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/fw-portfolio\/226\/revisions"}],"predecessor-version":[{"id":355,"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/fw-portfolio\/226\/revisions\/355"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/media\/234"}],"wp:attachment":[{"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/media?parent=226"}],"wp:term":[{"taxonomy":"fw-portfolio-category","embeddable":true,"href":"https:\/\/enriquegortiz.com\/wordpress\/enriquegortiz\/wp-json\/wp\/v2\/fw-portfolio-category?post=226"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}