Trying to test but I'm failing. It's probably me.

I was following the readme.md instructions in the test1 folder but not getting the expected result of the app reading a tweet and displaying its text. Granted, as a JS n00b, it's probably a user error.
What I've done on a system with Node (v16.14.2) and npm (v8.5.0) installed:

Cloned this repo.
Ran node install to pull in any dependencies/packages.
Entered newly generated Twitter API keys in twitterConsumerKey and twitterConsumerSecret fields found in config.json
Ran node main.js
See what appears to be a server running on port 1491, per the attached image.

Not sure what to do next: enter a command in the server, navigate to a web page (presumably localhost: ####), or something else?
I did nav to localhost:1491 and added some route info to the URL (/gettweet, for example) based on reading some of the code and got this console message:
davetwitter/handleRequest: urlCallback == http://localhost/callbackFromTwitter?redirectUrl=undefined
returnError: jstruct == {
    "statusCode": 404,
    "data": "{\"errors\":[{\"message\":\"Sorry, that page does not exist\",\"code\":34}]}"

Any guidance is appreciated but if I'm in over my head as n00b, I won't be offended if you say so. ;)

This is a server app, as you discovered, and the readme says that too. So this is not what you want. I’ll have a look around to see if I have the code you want in the form you want.
also if you just want to try ideas out, you might try drummer which can do exactly what you want, and it’s as simple as possible.

Then I went and looked at test1. You have to load index.html in a web browser after launching the server app.

Appreciate your checking and info, Dave. I tried loading index.html at localhost on port 1401 and on 1491, but the browser shows a "not found" message. Trying not to reinvent anything (as I likely couldn't anyway) and get some programmable read access to tweets. I'll close this out and look at Drummer, per your suggestion. Thanks!

Closing, per the above comment.

Kevin, I tried running the test1 app too and got the same result. I'm not sure what is going wrong.
It's an awful cycle -- I write this code hoping someone will try it, when I'm working on it, because it's best to catch problems when it's all fresh in my mind.  I probably haven't run that test code for years. And somewhere along the line it broke.
I really want to encourage you to keep at it.  I need about ten guys like you to work with me on this stuff. I know it's not your responsibility, but it's still true.
I'm not hearing much from Drummer users these days either, but I really tested the hell out of the Twitter verbs there, and documented them, look in the DocServer site under Twitter. And if there are any problems please report them.

No worries Dave, and I completely get where you're coming from. Once I move on from my little JS coding exercises to another one, a week goes by and if a classmate asks me about the older code, my mind goes blank. I can't imagine having to deal with that on a larger scale as you do.
I will keep at it because I like solving puzzles and I like learning. And I did poke around in Drummer this morning, created a script to get Tweets, got it in my menu and it returned expected results. :)

@kevinctofel -- that's good!
BTW, the Drummer twitter verbs run through this code, there are just a couple of levels inbetween, factoring out the hard stuff. ;-)

Right, that's what I gathered when browsing through the code files. I spent a good half hour looking around and while I won't claim to understand all of it, I get the general gist, features, and functions. If I don't have to spin up a server but could just use / call to Drummer for the Twitter bits I'm looking for, that will solve a big problem for a small project I have in mind.  I'll need to search though tweets for a specific keyword / regex, but I do that once I have the texts of the tweets. :)


Added movie recommendation engine

Type of change

[x] Added new project
[ ] Bug fix
[ ] New features
[ ] Enhanced documentation

Changes proposed in this pull request

Project name : movie recommendation engine using python

Short description : this program gives output names of movies similar to the one given as input by user, this output is same as the one you will get by a google search of the movie in "similar movies" section.

Checklist

[x] The code is Python 3 compatible
[x] I have added relevant comments in my file to make code understandable
[x] I have added my project in a folder which includes all the necessary files

Looks good , thanks for contributing 👍


Billing

Type: Bug
Hi,
I have a subscription and I still have to wait 6 hours.
ty
VS Code version: Code 1.96.1 (42b266171e51a016313f47d0c48aca9295b9cbb2, 2024-12-17T17:50:05.206Z)
OS version: Windows_NT x64 10.0.22000
Modes:

System Info

Item
Value

CPUs
AMD Ryzen 5 PRO 4650U with Radeon Graphics (12 x 2096)

GPU Status
2d_canvas: enabledcanvas_oop_rasterization: enabled_ondirect_rendering_display_compositor: disabled_off_okgpu_compositing: enabledmultiple_raster_threads: enabled_onopengl: enabled_onrasterization: enabledraw_draw: disabled_off_okskia_graphite: disabled_offvideo_decode: enabledvideo_encode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabledwebgpu: enabledwebnn: disabled_off

Load (avg)
undefined

Memory (System)
23.37GB (6.68GB free)

Process Argv
--crash-reporter-id 3e693621-f962-4e20-b546-0f2f3ca51ed4

Screen Reader
no

VM
0%

Extensions (34)

Extension
Author (truncated)
Version

azapi
aza
2.1.0

armview
ben
0.4.6

doxdocgen
csc
1.4.0

dbclient-jdbc
cwe
1.3.9

vscode-redis-client
cwe
8.0.4

vscode-markdownlint
Dav
0.57.0

copilot
Git
1.253.0

copilot-chat
Git
0.23.2

vscode-github-actions
git
0.27.0

terraform
has
2.34.1

vscode-drawio
hed
1.6.6

rainbow-csv
mec
3.13.0

git-graph
mhu
1.30.0

vscode-azure-github-copilot
ms-
0.3.61

vscode-azurefunctions
ms-
1.16.1

vscode-azureresourcegroups
ms-
0.9.9

vscode-azureterraform
ms-
0.3.2

vscode-bicep
ms-
0.32.4

vscode-docker
ms-
1.29.3

vscode-language-pack-es
MS-
1.96.2024121109

csharp
ms-
2.55.29

vscode-dotnet-runtime
ms-
2.2.3

debugpy
ms-
2024.14.0

isort
ms-
2023.10.1

python
ms-
2024.22.0

vscode-pylance
ms-
2024.12.1

vscode-ai
ms-
1.2.0

vscode-ai-remote
ms-
1.2.0

remote-containers
ms-
0.394.0

remote-wsl
ms-
0.88.5

azure-account
ms-
0.12.0

vsliveshare
ms-
1.0.5941

vscode-yaml
red
1.15.0

sonarlint-vscode
Son
4.14.0

A/B Experiments
vsliv368cf:30146710
vspor879:30202332
vspor708:30202333
vspor363:30204092
vscod805cf:30301675
binariesv615:30325510
vsaa593cf:30376535
py29gd2263:31024239
c4g48928:30535728
azure-dev_surveyone:30548225
962ge761:30959799
pythonnoceb:30805159
pythonmypyd1:30879173
h48ei257:31000450
pythontbext0:30879054
cppperfnew:31000557
dsvsc020:30976470
pythonait:31006305
dsvsc021:30996838
dvdeprecation:31068756
dwnewjupyter:31046869
nativerepl2:31139839
pythonrstrctxt:31112756
nativeloc2:31192216
cf971741:31144450
iacca1:31171482
notype1:31157159
5fd0e150:31155592
dwcopilot:31170013
stablechunks:31184530
6074i472:31201624

I have the "Copilot Individual" subscription, and over the past few months (since it was released), I have used it without any issues. Now I am getting the following message:
"Sorry, your request was rate-limited. Please wait 5 hours 43 minutes before trying again."

Hi @EstebanZ! Is this while using the o1-preview model in the model picker?

Hi @sbatten! yes, I am using that model. Next time it happens I'll try another one.

@EstebanZ Thanks for responding. As o1 is a more powerful model, you will hit a rate limit faster and wait longer for that limit to be reset. Other models should be available even if you have hit your limit on o1.


Implement select from repeat

https://docs.getodk.org/form-logic/#generating-select-ones-from-repeats

Works well!


mdbx_chk: do Main dbi full-check at start

Example long-running mdbx_chk which I interrupted by Ctrl+C in the middle:
mdbx_chk v0.10.5-0-gedda9515 (2021-10-13T16:35:26+03:00, T-31713895aac05dd55b3ebc8cadd419f96b38de54)
Running for /evo/mainnet/chaindata in 'read-only' mode...
 ~ skipped update meta.geo in recovery mode: from l3-n140401953-u536870912/s1048576-g524288, to l3-n140401953-u536870912/s1-g524288
 - monopolistic mode
 - current boot-id afbd54fddf3ad801-8106c58c535b4926
 - pagesize 4096 (4096 system), max keysize 1980..2022, max readers 118
 - mapsize<PHONE_NUMBER>552 (2.00 Tb)
 - dynamic datafile: 12288 (12.00 Kb) ..<PHONE_NUMBER>552 (2.00 Tb), +2147483648 (2.00 Gb), -4096 (4.00 Kb)
 - current datafile:<PHONE_NUMBER>88 (535.59 Gb), 140401953 pages
 - meta-0: steady txn#67409, tail, forced for checking
 - meta-1: steady txn#67411, head
 - meta-2: steady txn#67410, stay
 - skip checking meta-pages since the 0 is selected for verification
 - transactions: recent 67411, selected for verification 67409, lag 2
Skipping b-tree walk...
Processing<EMAIL_ADDRESS> - key-value kind: usual-key => single-value
 - last modification txn#67408
 - summary: 44 records, 0 dups, 526 key's bytes, 2112 data's bytes, 0 problems
Processing<EMAIL_ADDRESS> - key-value kind: ordinal-key => single-value
 - last modification txn#67408
 - fixed key-size 8
 - summary: 494 records, 0 dups, 3952 key's bytes, 26776204 data's bytes, 0 problems
 - space: 536870912 total pages, backed 140401953 (26.2%), allocated 140401953 (26.2%), available 403162516 (75.1%)
 - skip check used and gc pages (btree-traversal with monopolistic or read-write mode only)
Processing 'AccountChangeSet'...
 - key-value kind: usual-key => multi-value
 - last modification txn#67408
 - summary: 28621309 records, 28531308 dups, 228970472 key's bytes, 848425652 data's bytes, 0 problems
Processing 'AccountHistory'...
 - key-value kind: usual-key => single-value
 - last modification txn#67408
 - summary: 16000293 records, 0 dups, 448008204 key's bytes, 765509238 data's bytes, 0 problems
Processing 'BittorrentInfo'...
 - key-value kind: usual-key => single-value
 - last modification txn#4
 - summary: 0 records, 0 dups, 0 key's bytes, 0 data's bytes, 0 problems
Processing 'BlockBody'...
 - key-value kind: usual-key => single-value
 - last modification txn#67408
 - summary: 13446756 records, 0 dups, 537870240 key's bytes, 747138407 data's bytes, 0 problems
Processing 'BlockTransaction'...
 - key-value kind: usual-key => single-value
 - last modification txn#67408

^C - interrupted by signal
 - summary: 309979899 records, 0 dups,<PHONE_NUMBER> key's bytes,<PHONE_NUMBER>9 data's bytes, 0 problems
No error is detected, elapsed 91.456 seconds
mdbx_chk v0.10.5-0-gedda9515 (2021-10-13T16:35:26+03:00, T-31713895aac05dd55b3ebc8cadd419f96b38de54)
Running for /evo/mainnet/chaindata in 'read-only' mode...
 - monopolistic mode
 - current boot-id afbd54fddf3ad801-8106c58c535b4926
 - pagesize 4096 (4096 system), max keysize 1980..2022, max readers 118
 - mapsize<PHONE_NUMBER>552 (2.00 Tb)
 - dynamic datafile: 12288 (12.00 Kb) ..<PHONE_NUMBER>552 (2.00 Tb), +2147483648 (2.00 Gb), -4294967296 (4.00 Gb)
 - current datafile:<PHONE_NUMBER>88 (535.59 Gb), 140401953 pages
 - meta-0: steady txn#67409, tail
 - meta-1: steady txn#67411, head, forced for checking
 - meta-2: steady txn#67410, stay
 - skip checking meta-pages since the 1 is selected for verification
 - transactions: recent 67411, selected for verification 67411, lag 0
Skipping b-tree walk...
Processing<EMAIL_ADDRESS> - key-value kind: usual-key => single-value
 - last modification txn#67408
 ! corrupted leaf-page #77581853, mod-txnid 67410
 ! invalid page txnid (67410) for parent-page' txnid (67408)
 ! mdbx_cursor_get() failed, error 1 Operation not permitted
 - problems: different number of entries (1)
 - summary: 0 records, 0 dups, 0 key's bytes, 0 data's bytes, 1 problems
 ! abort processing '@GC' due to a previous error
 - space: 536870912 total pages, backed 140401953 (26.2%), allocated 140401953 (26.2%), available 396468959 (73.8%)
Total 4 errors are detected, elapsed 0.007 seconds.

As you can see, error ! corrupted leaf-page #77581853, mod-txnid 67410 was found at the end.
Is it possible to move (or add) this check (of Main dbi) to the start of mdbx_chk work?
Main dbi is small - likely it will be cheap. But, such move will allow mdbx_chk "fail fast" on this scenarios. (to find good meta-page faster).

How about moving this check from end to start of mdbx_chk?

How about moving this check from end to start of mdbx_chk?

No, since this is unreasonable.
In general, for a complete check, it is always necessary to first walk a page tree, and only if successful, then walk an entries via cursor.

However, with this database I saw a problem related to #238, i.e. seems that:

some time you ran this DB with v0.10.5;
then was commit 3 transactions with some release early than v0.10.5;
and at the the end have checked it by mdbx_chk v0.10.5.

At a whole this gave a false-positive diagnosis of database corruption - I'll think about what to do.

At a whole this gave a false-positive diagnosis of database corruption - I'll think about what to do.

@AskAlexSharov, any ideas are welcome.

for a complete check - yes, but before complete check and switch meta-page - there is another step "to find which meta-page are for sure bad, and don't run complete check for them", because complete check is long. But i'm fine with "no".


Zip Bomb Detection

Maybe this is handled already but I am not certain.
In the agent.py, I see it is wrapped in a try...catch but how it would handle if a Zip Bomb were uploaded to the server and it attempted to unzip it?

Well, it's not really handled, but it will result in the guest VM to you know, unpack the file until it runs out of resources. So basically it will fail to analyze properly and then after one or two minutes it will simply quit and Cuckoo will have a happy life afterwards.
Not sure if Cuckoo is supposed to handle it any better? :-)

Going to close this issue as irrelevant for now. In the future when we have Host-side pre-analysis of submitted files this might be a small issue todo item, but other than that it's nothing too special.


RunWorkerAsync runs twice and causes an InvalidOperationException

The issue is similar to my first commit, whenever I'm changing the url of the video while the program is retrieving the title, it fires off an InvalidOperationException.
I believe it was caused by another RunWorkerAsync() when the condition hits the else statement in:
        if (!YTtitlebackgroundWorker.IsBusy)
        {
            YTtitlebackgroundWorker.RunWorkerAsync(urlData);
        }
        else
        {
            YTtitlebackgroundWorker.CancelAsync();
            YTtitlebackgroundWorker.RunWorkerAsync(urlData);
        }

Which causes to run another runworkerasync if the backgroundworker is busy.
I have tried a small but temporary fix by removing the entire block of the else statement and simply replaced it with a messagebox saying that the program is currently retrieving the title:
        else
        {
            MessageBox.Show("The program is already retrieving the title");
            //YTtitlebackgroundWorker.CancelAsync();
            //YTtitlebackgroundWorker.RunWorkerAsync(urlData);
        }

I can run a commit to this, but I have to test it out if it affects the downloading process.

Looks like it wasn't affecting the retrieval of the title when the messagebox pops up.

Is this fixed now or does this exception still occur? I tried to check it but title retrieve is too fast for me to change the url while it is retrieving. Do you have a slow internet connection?

Yes, I tested this on a slow connection. I fixed this on commit f48f1da6fee811a9f28e2e0a81d31531ecf1b2c4. I believe the exception doesn't allow more than one .RunWorkerAsync() if the worker is already busy. The title is still being retrieved even when you change URLs fast.

Alright, then I'm closing this issue.


Problem in building env

Hi, thank your for your public reproducing project. I just followed your guidance including downloading multi-agent environment. But there is an error when ran the main.py.
File "/home/l/anaconda3/lib/python3.7/site-packages/gym/core.py", line 64, in reset
    raise NotImplementedError
NotImplementedError

Looking forward to your reply.

I faced the same issue

Are you using the gym version specified in the README?

Thank you, @shariqiqbal2810  . I initially did not use the correct version you mentioned. After I changed version the problem was resolved.

Thank

Hi, I also met the same problem , how you solved this issue, thanks a lot~

Thank you, @shariqiqbal2810 . I initially did not use the correct version you mentioned. After I changed version the problem was resolved.

Hi, I also met the same problem , how you solved this issue, thanks a lot~