• A hardware neural net? Evolving consciousness

    Posted in Neural Nets and AI Stuff on May 31, 2017

    This is fascinating, I don't know how to put words around this yet. The study is running a hardware (FPGA) version of the same kind of process used to develop a neural net. Basically it's evolving a chip that can perform a certain intelligent action, and the technique can be used to develop just about any intelligent action. The real interesting part here is how it uses artifacts of the chip circuitry that are NOT part of the intended chip design to achieve its purpose in a way that baffles the people who open the chip up and investigate it after it succeeds. I'm most curious about this part, ...

  • Did more of Euclid's postulates have the same problem as the fifth?

    Posted in Mathy Stuff, Neural Nets and AI Stuff on May 30, 2017

    It just occurred to me the famous problem with Euclid’s fifth postulate can also be seen hidden in the first four postulates, which are said to be true because they are intuitively obvious. Let's look at them:

    1. To draw a straight line from any point to any point.
    2. To extend a finite straight line continuously in a straight line.
    3. To describe a circle with any center and radius.
    4. That all right angles are equal to one another.

    The 5th postulate stood out because "it cannot be directly observed through construction." This is because all constructed lines are necessarily finite, whe...

  • Finally understand backpropagation for neural nets

    Posted in Neural Nets and AI Stuff on May 30, 2017

    Well I cannot speak highly enough of this guide into Neural Nets written for people who already understand software programming: Hacker's guide to Neural Networks. I wouldn't suggest it for people who don't program, but it's a very good example of how to target a reader like me. He starts with a very basic intuitive example, then goes into a slightly more complex example of the same basic idea, then a third slightly more complex example, and finally the fourth example, where backpropagation is finally shown in all its humble glory.

    The first time I read it, I understood the first example okay...

  • Still learning about derivatives in order to understand neural nets

    Posted in Mathy Stuff, Neural Nets and AI Stuff on May 29, 2017

    I'm coming at this from a number of angles; not all of them are making an appearance in this series of posts. Here's one, though: I got a few more insights in conversation yesterday with a friend who said "What? You don't know calculus? I thought by all your math posts online you knew basics like calculus."

    "No, I understand math intuitively, not logically..." I responded,  attempting an explanation about how I approach math. He kindly responded by launching into a basic explanation of calculus without realizing what I was saying.

    After a couple minutes of trying to figure out what he was sayi...

  • Learning calculus in order to understand neural nets

    Posted in Mathy Stuff, Neural Nets and AI Stuff on May 28, 2017

    I've decided I need to learn what derivatives are before I can get to the heart of understanding what's happening inside the "hidden layers" of neural nets, and backpropagation is still not making sense for me. Turns out derivatives are at the heart of calculus. I avoided calculus all my life, but now I have an actual use for it, so here goes. But first, a rant of sorts.

    It took me a long time to figure out that the reason I didn't like math is because I organize information intuitively, thinking in pictures, not logically, or linearly, and most math is taught, even to those who learn linearly...

  • Neural nets: How should one tweak the input slightly to increase the output?

    Posted in Neural Nets and AI Stuff on May 26, 2017

    A good example of how an idea expressed with too abstract a manner confuses me while giving me a visual generally makes it easy. Here is an early point in understanding what neural nets do, which I read elsewhere several times before seeing it here in a manner that makes it easy. Click on the image below to go to the original web page, Hacker's guide to Neural Networks, which is a lot easier for me to understand than the similar material in chapter 1 of the Neural Networks and Deep Learning book I mentioned earlier.

     

     

  • Are neural networks positivists?

    Posted in Neural Nets and AI Stuff, Postinfinity Tergiversation on May 26, 2017

    I've only just started studying neural networks, so take this with a grain of salt. I'm stumbling around in the normal way of beginning complex subjects, avoiding things like unintuitive algebra and heading toward intuitive visualizations of ideas wherever possible til I get a sense of the field, and I come across this image where you can see the neural network operating on the task of separating a red and a blue spiral from each other. This illustration comes from an article Neural Networks, Manifolds, and Topology

    Neural Net separating red and blue spirals

    As I'm watching it, I suddenly get the next little piece of information I'm t...

  • Neural Nets need to be deep before they work well

    Posted in Neural Nets and AI Stuff on May 26, 2017

    I'm reading Neural Networks and Deep Learning and it drifts off into Algebra a little more than my intuitive brain wants. So I google around a little more to try and understand what's happening with backpropagation, sigmoid neurons, perceptrons, and find the following video. A decent survey of the journey we've taken to get neural nets working. Turns out that, after many years of puzzling over why they weren't working so well, neural nets started working when people figured out that they needed to have many more layers than they first expected, and needed to train on much more data than they s...

  • A Neural Networks, Deep Learning, CyberIntelligentsia, and Kabbalah "Hello World"

    Posted in Neural Nets and AI Stuff on May 25, 2017

    I just started learning about cybernetic intelligence in a practical way, no longer consigned to reading about it as an interesting idea that flies past quickly, but now thinking more seriously about it. Got a few steps inside the gate, reading a few pages of text on my small phone browser and thinking about it for a few days, then just now decided it will be fun to document my journey online since it looks like I'll be diving deep before this is finished. I already have some ideas for projects I'd like to work on, including an ambitious one which I've been thinking about for years. After a fe...

  • How to Fix SQL Server Error 10055

    Posted in Developing Software on Apr 28, 2017

    Since it's actually an OS issue more than a DB issue, this solution works for more than just MySQL which is mentioned in the article linked below. This fix is the only one that worked for me using SQL SERVER after trying everything else. So I figured I'd put this out there for others to find:

    "How to Fix MySQL Error 10055" http://blog.whitesites.com/How-to-Fix-MySQL-Error-10055__635140180116307813_blog.htm

    Short version:

    On Windows Server 2008 R2 Open command Prompt

    Type the following netsh int ipv4 set dynamicport tcp start=10000 num=50000 Press Enter

    Type the following netsh int ipv4 set dyn...