• by _tom_ on 11/28/2021, 5:16:32 AM

    There are to many tags to be useful, and the quality of tags is low.

    For example, I searched for banana boat, thinking of the song. "Song" was not one of the tags offered. Nor "day-o", nor Belafonte. But I did get "formation of an attorney-client relationship" and "High levels of benzene". It looks like both of those have a high number of other, related tags, like someone pulled a bunch of tags from one or two web pages. I see what looks like a cluster of "sun & sunscreen related" good, but should only be one or two tags. "Food", also good. Also should be just one or two tags. "Law", shouldn't be there at all, unless there is some POPULAR legal aspect of banana boats I'm not aware of, and "toxic chemicals", should be one or two at most, and probably should not be there at all.

    I think something is wrong with your clustering. You are not getting the right clusters, and you are going too deep into the clusters you have.

    FYI: The song is the first video hit on google, and the top of the second page of general results.

    Tried star trek. Still too many tags. Tags are more related, but there are ones that clearly aren't important enough in relation to warrant being a top tag, like "former Viacom", "smaller population countries", "notable exceptions", "extreme example", "generic rule of thumb".

    Keep refining! :-)

  • by shamilbi on 11/28/2021, 7:43:56 AM

    > We share your IP address and your search query with Microsoft Bing, as we use the BING API as our search engine backend

  • by dotancohen on 11/28/2021, 7:41:44 AM

    Nice job. Linux and Ubuntu related searches have very relevant results.

    The only constructive criticism that I have would be regarding presentation. There is far too little contrast between the results URL and the white background. And I don't know what markup language you're using but results cannot be opened in a new tab via middle click (current Firefox, current Ubuntu). Not to mention that my Tridactyl extension is completely useless on the site.

    Please, just serve results in normal HTML and let the browser handle the presentation. For every clever behavior you think you're adding, you are actually breaking a feature that somebody uses.

  • by ykevinator2 on 11/28/2021, 1:10:37 PM

    Its a great idea and you should keep going with this (and nice work so far). You may want to consider the idea of only presenting disambiguating tags. A simple heuristic like finding the top x tags of close to equal cardinality and throw the rest away. The value of what you've built is disambiguation and if you present every single tag, most of those tags are noise. Hope this helps.

  • by Cilvic on 11/28/2021, 6:40:45 AM

    It seemed to work Ok.

    I found the number of tags far too many to be really useful. I'm searching for an answer/not more problems.

    UI wise I was irritated, that clicking the tag only had a visible effect after I moved the mouse away. First time i clicked (toggled on), then clicked again (toggled off).

    I was thinking about a search engine that would help me chose the right direction of there are multiple interpretations.

    My test was searching for "quasar" and seeing if the vue js framework would be offered as tag (which it's not). But it's actually result number 3?

    How are the tags related to the results?

    I've also found it irritating that selecting the tags need to be "applied" without having an idea of what it will do, or how many results there are.

    Maybe apply the selected tag immediately and keep the tags in the same UI location (don't reload them, like you currently do after applying).

    I'm not sure what's the perfect search example is for this. Because narrowing down by keyword is easy. Here it's almost like it helps you discover keywords/tags that are yet unknown?

  • by marginalia_nu on 11/28/2021, 10:29:45 AM

    Neat. I do think there is a lot of room to refine the search engine interface. If the dumpster fire that's Google it's pretty clear that natural language search is just not a good approach. It's extremely frustrating when the search engine is second guessing you.

    Your "tags" look like search terms, like key n-grams. I'm guessing because when I extract search terms from a document, I get stuff of a similar "vibe". Maybe easier if I show than try to describe, this is from a unit test I have that runs keyword extraction code on a few documents. I think these are from some page about SSH clients

      unix_source, msi, ssh_authentication_agent, gitweb, pscp, cryptographic_checksums, windows_source, ssh, puttytel, command-line_secure, telnet, windows_html, most_up-to-date_version, psftp, zip, scp, standalone, version_of_putty, scp_client, dsa, putty, plink, rsa_and_dsa, sftp, binaries, unix, up-to-date_version, checksums, rsa, individual_executables, 64-bit_arm, 64-bit_version, source_archive, .zip_archive, 32-bit_arm, latest_release, checksum, standalone_binaries, cryptographic, windows_on_arm, ftp, zipped, versions_of_putty, alternative_binary_files, unix_source_archive, download_putty, sftp_client, latest_released_version, ssh_and_telnet_client, ssh_and_telnet
    
    I've been playing with the idea of doing some sort of Naive Bayes-categorization of the general topic of a web page and using those to offer a broad filtering on my search results. May be a lot of work since it relies on a degree of manual curation, but seems be doable once you have a decent model cooked up. I'd like, when you search for Plato, to be able to offer the alternative of refining the search to the philosopher or the computer system.

  • by visarga on 11/28/2021, 5:16:27 AM

    It's fast and apparently wide enough, or at least I found what I searched for. Summarisation is nice.

    UI: The refining keywords are hard to read because they are not sorted. The gradient borders around search results are a bit too much, better go with something more understated.

    It would be nice to tell a few things about the underlying technology. Are you using other search engines under the hood? How large is the index?

  • by Ketan-fullstack on 11/28/2021, 2:48:03 AM

    Hi, I have been working on this search engine for the last few months. After you search for something, you can select up to 4 tags to further refine your search.

    Feedback please :)

  • by gathersight on 11/30/2021, 12:44:46 PM

    Nice and fast. How are you extracting the data for the Summary tab? On the searches I tried, it pulled in a block of, seemingly, random text from mid-way down the destination page. It didn't appear to be summarizing anything.

  • by tmsh on 11/28/2021, 5:40:34 AM

    works really well for general topics like nextjs (helps capture what's out there to search for).

  • by TruthWillHurt on 11/28/2021, 10:29:19 AM

    Amazing. However - I did a test where I searched for "Python cast" and got variable type casting results.

    I then wanted to refine the search to the cast of Monty Python, but had no relevant tags to do it with.

    In google the 6th result on first page was Monty Python wikipedia page.

  • by boffinism on 11/28/2021, 6:57:42 AM

    I looked at this on mobile and on my first attempt had no idea what the point of this was. (Hint to others on mobile: scroll to the bottom of the search results page.)

  • by sealeck on 11/28/2021, 12:18:10 PM

    https://search.marginalia.nu is another interesting search engine

  • by senectus1 on 11/28/2021, 5:58:43 AM

    hot damn!

    Please add the ability to scroll down the popped up suggestions with cursor keys!

  • by senectus1 on 11/28/2021, 11:52:43 AM

    how do we add this as a custom ending in chromium?

    do we still use the same qury as the bing one? {bing:baseURL}search?q=%s&{bing:cvid}{bing:msb}{google:assistedQueryStats}