• Still learning about derivatives in order to understand neural nets

    Posted in Mathy Stuff, Neural Nets and AI Stuff on May 29, 2017

    I'm coming at this from a number of angles; not all of them are making an appearance in this series of posts. Here's one, though: I got a few more insights in conversation yesterday with a friend who said "What? You don't know calculus? I thought by all your math posts online you knew basics like calculus."

    "No, I understand math intuitively, not logically..." I responded,  attempting an explanation about how I approach math. He kindly responded by launching into a basic explanation of calculus without realizing what I was saying.

    After a couple minutes of trying to figure out what he was sayi...

  • Learning calculus in order to understand neural nets

    Posted in Mathy Stuff, Neural Nets and AI Stuff on May 28, 2017

    I've decided I need to learn what derivatives are before I can get to the heart of understanding what's happening inside the "hidden layers" of neural nets, and backpropagation is still not making sense for me. Turns out derivatives are at the heart of calculus. I avoided calculus all my life, but now I have an actual use for it, so here goes. But first, a rant of sorts.

    It took me a long time to figure out that the reason I didn't like math is because I organize information intuitively, thinking in pictures, not logically, or linearly, and most math is taught, even to those who learn linearly...

  • Neural nets: How should one tweak the input slightly to increase the output?

    Posted in Neural Nets and AI Stuff on May 26, 2017

    A good example of how an idea expressed with too abstract a manner confuses me while giving me a visual generally makes it easy. Here is an early point in understanding what neural nets do, which I read elsewhere several times before seeing it here in a manner that makes it easy. Click on the image below to go to the original web page, Hacker's guide to Neural Networks, which is a lot easier for me to understand than the similar material in chapter 1 of the Neural Networks and Deep Learning book I mentioned earlier.



  • Are neural networks positivists?

    Posted in Neural Nets and AI Stuff, Postinfinity Tergiversation on May 26, 2017

    I've only just started studying neural networks, so take this with a grain of salt. I'm stumbling around in the normal way of beginning complex subjects, avoiding things like unintuitive algebra and heading toward intuitive visualizations of ideas wherever possible til I get a sense of the field, and I come across this image where you can see the neural network operating on the task of separating a red and a blue spiral from each other. This illustration comes from an article Neural Networks, Manifolds, and Topology

    Neural Net separating red and blue spirals

    As I'm watching it, I suddenly get the next little piece of information I'm t...

  • Neural Nets need to be deep before they work well

    Posted in Neural Nets and AI Stuff on May 26, 2017

    I'm reading Neural Networks and Deep Learning and it drifts off into Algebra a little more than my intuitive brain wants. So I google around a little more to try and understand what's happening with backpropagation, sigmoid neurons, perceptrons, and find the following video. A decent survey of the journey we've taken to get neural nets working. Turns out that, after many years of puzzling over why they weren't working so well, neural nets started working when people figured out that they needed to have many more layers than they first expected, and needed to train on much more data than they s...

  • A Neural Networks, Deep Learning, CyberIntelligentsia, and Kabbalah "Hello World"

    Posted in Neural Nets and AI Stuff on May 25, 2017

    I just started learning about cybernetic intelligence in a practical way, no longer consigned to reading about it as an interesting idea that flies past quickly, but now thinking more seriously about it. Got a few steps inside the gate, reading a few pages of text on my small phone browser and thinking about it for a few days, then just now decided it will be fun to document my journey online since it looks like I'll be diving deep before this is finished. I already have some ideas for projects I'd like to work on, including an ambitious one which I've been thinking about for years. After a fe...

  • How to Fix SQL Server Error 10055

    Posted in Developing Software on Apr 28, 2017

    Since it's actually an OS issue more than a DB issue, this solution works for more than just MySQL which is mentioned in the article linked below. This fix is the only one that worked for me using SQL SERVER after trying everything else. So I figured I'd put this out there for others to find:

    "How to Fix MySQL Error 10055" http://blog.whitesites.com/How-to-Fix-MySQL-Error-10055__635140180116307813_blog.htm

    Short version:

    On Windows Server 2008 R2 Open command Prompt

    Type the following netsh int ipv4 set dynamicport tcp start=10000 num=50000 Press Enter

    Type the following netsh int ipv4 set dyn...

  • Google is less concerned with how awesome you appear, than how awesome you actually are

    Posted in Developing Software, Everything on Apr 15, 2017

    Insightful article about going beneath the surface layer to understand people. Google attracts enough talent that it can afford to look beyond the obvious factors in hiring. For example: "leadership — in particular emergent leadership as opposed to traditional leadership. Traditional leadership is, were you president of the chess club? Were you vice president of sales? How quickly did you get there? We don't care. What we care about is, when faced with a problem and you're a member of a team, do you, at the appropriate time, step in and lead. And just as critically, do you step back and stop l...

  • Sony patent application talks about method for wirelessly juicing up devices via NFC

    Posted in Everything on Mar 19, 2017


    Wirelessly charging your phone using your friend's phone? You have to hand it to Sony for bright ideas. James Milne, True Xiong and Charles McCoy are named as the inventors on a Sony patent application published earlier this month.

    A patent application published earlier hits month was filed in November last year and is titled, "Configuration of Data and Power Transfer in Near Field Communications."

  • How Humans Invented Numbers—And How Numbers Reshaped Our World | Innovation | Smithsonian

    Posted in Everything on Mar 19, 2017