in office

 Ko Nishino, Ph.D.

  Associate Professor
  Department of Computer Science
  College of Computing and Informatics
  Drexel University



News

  • Our new paper on discovering visual material traits: intermediate representations of local material appearance (what makes materials look the way they look). Our key idea is to probe human material perception via simple yes/no questions to extract the underlying representation that enables visual discrimination of materials locally (i.e., without knowledge of global context like object shape). We confirm that the discovered visual attributes can be combined with boolean algebra to match semantically meaningful attributes (e.g., smooth and shiny).
    • Automatically Discovering Local Visual Material Attributes
      G. Schwartz and K. Nishino,
      in Proc. of IEEE Conference on Computer Vision and Pattern Recognition CVPR'15, Jun., 2015 [ PDF ]
    Please also check out our preceding work on fully-supervised visual material traits.
    • Visual Material Traits: Recognizing Per-Pixel Material Context
      G. Schwartz and K. Nishino,
      in Proc. of Color and Photometry in Computer Vision (Workshop held in conjunction with ICCV'13), Dec., 2013. [ Paper PDF ] [ Slides PDF ]
    We have also released our annotations of the Flickr Materials Database which we used for these research projects.
    Visual Material Traits: Trait Annotations: We have augmented the Flickr Materials Database (FMD) of Sharan et al. with binary mask annotations for 13 visual material traits. We consistently annotated FMD images with material trait masks that highlight only local regions indiciative of each trait.
  • A talk I gave this summer that summerizes our research towards material recognition.

    Material Recognition from Images (Invited Talk at Shitsukan Symposium 2014)

  • Please check out code/database. We make available many of our code and data used in our research.

I am an Associate Professor of Computer Science at Drexel University. Prior to joining Drexel in fall 2005, I was a postdoctoral research scientist at Columbia University. I received all my degrees from The University of Tokyo: both BE and ME in Information and Communication Engineering from the Department of Electrical and Electronical Engineering in 1997 and 1999, respectively, and PhD in Computer Science from the Department of Computer Science in 2002.

My research interests primarily lie in computer vision. In particular, I strive to develop novel models and computational algorithms to better extract, understand, and regenerate visual information from photographs and videos. To this end, my main focus centers on leveraging intrinsic structures of visual data -- the latent structures that can be found in the geometry, radiometry, and motion of real-world scenes that are not necessarily apparent to our naked eyes.

Curriculum Vitæ

Contact

Department of Computer Science
Drexel University
3141 Chestnut Street,
Philadelphia, PA 19104

Office: University Crossings 100G
Tel: (215) 895-2678
Fax: (215) 895-0545
e-mail: kondrexel.edu

Group Members

Prospective students: I am looking for Drexel MS student(s) to work on some exciting projects. Please contact me, if you think you qualify.

I am looking for a few PhD students to start in Fall 2015. If you are interested in studying towards a PhD degree under my guidance, please just go ahead and submit your application through the official channel (see this page). If you are interested in working with me, please state so in your essay/statement and explain your motivation, credentials, plan, etc. There is no need to contact me and unfortunately I will not have the time to respond to individual inquiries.

PhD Students Steve Lombardi
Gabe Schwartz
Leizer Teran
Past Students Geoff Oxholm (PhD CS, June 2014, Adobe Research)
Louis Kratz (PhD CS, June 2012, Curalate)
Prabin Bariya (MS CS, June 2011)
Ian Johnston (BS Math, June 2010, Boston University)
John Novatnack (MS CS, June 2008, Google)