Combing Epoll and Inotify?

So apparently the crate is transitioning Epoll to a new safer (and better documented!) abstraction. But this has yet to be released. Fine I thought, since I'm starting a new project, I will just use the latest master for now and switch to the next release that contains this.
However, it seems that Inotify (which I also need) has lost AsRawFd, but not gained a replacement to allow it to be used together with Epoll? For my use case I need to epoll a few FDs, one of which is an inotify FD (that monitors a few files). Thus I need a way to combine these. I would prefer to avoid threads for this.
Is there no way to do this currently or am I missing something obvious?

Note: This is probably related to issue #1750 and may be an oversight in how to combine things.

I think you're asking for a way to use AsFd with Epoll?

I would want to use AsFd on Inotify such that I can monitor for new Inotify events with Epoll while also monitoring for other things. This lets me keep my program single threaded.
I have this workaround for now (horrible mess, and probably not sound, but it works):
// Workaround for missing AsFd for Inotify in nix!
//
// There is no way to get the FD out of inotify and into epoll. We have to stupidly resort to unsafe code.
//
// This is based on Inotify::init
//
// SAFETY: Well, it actully isn't unsafe, since we aren't doing silly things like mmaping
//         this etc. It won't lead to memory issues.
//         HOWEVER: The IO safety is wrong, we are creating two copies of the same FD.
//         This can only be fixed in nix itself. But the way we use it below is okay.
unsafe fn create_inotify<'a>(
    flags: InitFlags,
) -> Result<(Inotify, BorrowedFd<'a>), Box<dyn Error>> {
    let fd = Errno::result(unsafe { libc::inotify_init1(flags.bits()) })?;
    Ok(unsafe { (Inotify::from_raw_fd(fd), BorrowedFd::borrow_raw(fd)) })
}

// [Lots of code elided here.]

pub(crate) fn monitor(
    mut listeners: Vec<Box<dyn Listener>>,
    timeout: Duration,
) -> Result<(), Box<dyn Error>> {
    // SAFETY: Epoll and inotify lives equally long. This is safe.
    let (inotify, ifd) = unsafe { create_inotify(InitFlags::IN_CLOEXEC | InitFlags::IN_NONBLOCK)? };
    let epoll = Epoll::new(EpollCreateFlags::EPOLL_CLOEXEC)?;

    epoll.add(
        ifd,
        EpollEvent::new(EpollFlags::EPOLLIN | EpollFlags::EPOLLERR, INOTIFY_HANDLE),
    )?;

    // [Add other things to epoll here]

    loop {
        let mut events = [EpollEvent::empty(); 32];
        epoll.wait(&mut events, timeout.as_millis() as isize)?;
        // Process events
        for ref event in events {
            match event.data() {
                INOTIFY_HANDLE => {
                    for ievent in inotify.read_events()? {
                        // [Process inotify stuff here]
                    }
                }
                // [Process other file descriptors here]
            }
        }
    }
}

The way to fix this would be to add impl AsFd for Inotify.

Side note: I find it weird that the epoll API takes a pre-allocated array (nice, no allocations) while Inotify returns a Vec. Consistency there would be nice. I prefer the pre-allocated array (since it can be allocated on the stack and avoid heap allocations).
Also the docs for Inotify::read_events appears to be incorrect: The docs read "Returns as many events as available.". This does not seem to be the case when reading the code. It looks to me like it will read as many events as are available and fit into a 4096 byte buffer. If the buffer gets filled it will not read more. Though that may be complicated in blocking mode (what if there was exactly 4096 bytes available?) etc. Consider changing the documentation instead.

SAFETY: Well, it actully isn't unsafe, since we aren't doing silly things like mmaping this etc. It won't lead to memory issues.

This is incorrect, in general. If the fd is used after it has been close, the same fd number may be reallocated to something else, which may be mmaped. So it could in principle cause soundness issues in combination with other code that is correctly using mmap. Though I don't believe it's normal to write to an inotify fd, so to get undefined behavior here would require somewhat convoluted code.

I don't quite understand why the compiler accepts it in fact!

BorrowedFd::borrow_raw returns a BorrowedFd with a generic lifetime. It's up to the caller to make sure it is sound. It is possible (but not necessarily sound) to have your function calling return an arbitrary generic lifetime as well.

I think impl AsFd for Inotify should definitely work.  Would you care to submit a PR?


MGDSTRM-9284: Change broker log configuration to sync with upstream kafka and remove unused config

Why:
We are syncing our log levels with upstream kafka defaults. The default for this logger changed here: https://github.com/apache/kafka/commit/c59835c1d7281863722f5c11b54e6b9c07070304
MGDSTRM-9284

AFAIK the log4j changes do not roll the brokers, the broker checks the update of the file every 30 secs.


feat: add PVCs for Hedera Nodes

Description
This pull request changes the following:

add PVCs for Hedera Nodes

Related Issues

Closes #786

Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 67.17%. Comparing base (a12cb1c) to head (16522a4).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff            @@
##               main     #792   +/-   ##
=========================================
  Coverage     67.17%   67.17%
  Complexity      339      339
=========================================
  Files            64       64
  Lines          1319     1319
  Branches        157      157
=========================================
  Hits            886      886
  Misses          370      370
  Partials         63       63

:tada: This PR is included in version 0.23.0 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


1.21 "/function kyubion:admin" fireworks does not show up on the homepage for the mod version.

I cannot remove the ever-present calendar feature as a result. It's a bit annoying.

Fixed in 1.0.1

it just says unknown function in chat

it just says unknown function in chat

Are you sure you have downloaded the right version? This bug has been fixed already.


[Documentation Bug]: updation in readme file

Describe the bug ✍
there is no documentation for using or creating the project or game
Provide step by step information reproduce the bug 📄
/

[ ] Description
[ ] How to play
[ ] Display of Game

Select program in which you are contributing
GSSoC24
Code of Conduct

[X] I follow CONTRIBUTING GUIDELINE of this project.

Hey @msifran !
Thank you for raising an issue 💗
You can self assign the issue by commenting /assign in comment 😀
Make sure you follow CODE OF CONDUCT and CONTRIBUTING GUIDELINES 🚀
Don’t Forget to ⭐ our GameZone🎮
Make sure you join our Discord🕹


A BUG on Safari?

If one of my songs is end and i'm looking at another label of Safari,Aplayer won't play next song.

It seems that Safari forbid autoplay audio in background.


Continue package support

@JiHong88
Hello, thank you for releasing the next version and continuing to support this valuable package
We are in dire need and waiting for the next versions.
@JiHong88
Can you inform us about the situation?

@Saeeed-B
There was absolutely no time to work. :(
This is the progress link for version "2.42.0".
I started working again today, and we will finish it as soon as possible.

@JiHong88
I'm very worried about suneditor.
This is one of the best hosts. I am very interested in continuing his life.
But I do not have the power of financial support, but I have a few suggestions:
Seek financial support to continue working
Submit a document to get acquainted with its core so that we can work on this package.
Provide a strong document so we can work with the core and fix bugs.

@Saeeed-B
Thanks for the advice.
We will improve a lot of things in the "3.0.0" version.
When it comes to improvement alone, there is no one to consult with, so it is difficult, but the rescue has progressed to some extent.
After, I will create a new site and documentation as soon as possible with the release of the 3.0.0 version.


Upgrade packages

Codecov Report

Merging #288 into master will not change coverage by %.
The diff coverage is n/a.

@@            Coverage Diff            @@
##            master      #288   +/-   ##
=========================================
  Coverage   100.00%   100.00%
=========================================
  Files            5         2    -3
  Lines           43        33   -10
  Branches         9         9
=========================================
- Hits            43        33   -10

Impacted Files
Coverage Δ

components/TopicListChalk.vue

components/Comment.vue

components/TopicList.vue

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4ed0c32...36d2294. Read the comment docs.


Filename always returns blob

after append data to multipart it always return data with filename "blob" without any extension. how to send filename as original filename in result object.

when you append form data, specified the filename as:
formData.append('file', result, result.name);


fix(instrumentation-http): resume responses when there is no response…

Fixes #4316
There is a memory leak in node 20 which is a manifestation of a problem that has been around for a while. If a user makes an http request and doesn't add a response listener to the request, the response body is typically dropped by the node runtime. The HTTP instrumentation adds a listener, which prevents the runtime from dropping the body. We should resume the response in order to put the stream back into flowing mode, which will cause the runtime to have the correct behavior after our callback returns.
This is fixed in the next branch by #4331 but if this merges first I will remove it from there.

Well, it's actually not a leak in node.js and it's not new in node.js 20.
Caller is responsible to consume the data according to docs.
Instrumentation adds a response listener and this avoids the automatic data discard. So it's the instrumentation which causes the leak here in case user doesn't set a response listener and consumes the data. Data is kept in the incoming socket queue.
The reason why this was hidden in node 18 is that node 20 uses connection keep alive on default. As a result the socked data queue got more and more data.


Allow using from_iter instead of collect

Clippy started warning that we use from_iter instead of collect, but why not just letting us do that.

bors r+

bors try

The lint description makes sense: https://rust-lang.github.io/rust-clippy/master/#from_iter_instead_of_collect
I haven't looked but seems like we can probably fix this without a breaking change - I can take a look this too and PR to re-enable the lint over the weekend if it's still a problem 👍

@domodwyer If you want to take some time to fix every place where we use the from_iter method where we should use collect, I would be very thankful :)

Easy! https://github.com/RoaringBitmap/roaring-rs/pull/78
I will rebase #76 after the PR is merged 👍

Thank you for #78 but you don't need to rebase, bors will do that for us automatically :)


chore: rm deposit contract config for op

does not exist for op, can be removed
ref https://github.com/paradigmxyz/reth/pull/11415

Can we check the codepath for full node? What will the receipts pruning do

https://github.com/paradigmxyz/reth/blob/d5ddb4129d3464d0f5cbfdd7547528bdb278cd59/crates/node/core/src/args/pruning.rs#L106-L111
for op this would never delete receipts, unsure if correct @shekhirin ?

@mattsse if there's no deposit contract, then we will prune MINIMUM_PRUNING_DISTANCE which seems to be fine?

yeah this seems fine


Pages build action not running

I went to test the latest update but it failed with the RABC issue. This is because Helm updates are not getting published as the Pages Build and Deployment action has not run to publish the new Helm charts

If you open the actions for Release Chart action, you will see a warning with a link explaining it in more detail. The bottom line is that they deprecated actions/checkout@v2 in favour of actions/checkout@v3. It may be worth trying that, but I don't have time for that now.

I'll check it out.

index.yaml is updated with 0.2.0 now. Sorry for the inconvenience. I setup branch protection for gh-pages branches and this prevented the Github Action from pushing updates to that branch after the new tag and release were created.


Draft: CJ-Client-Signup Merge

Still needs tweaking but its all laid out there. Will still need improved CSS but the easiest page to code is around the 50% done mark (I think)

Cool keep going on it. I won't merge it until you're done with it then I'll have another look but from what I can see it's lookin good so keep goin.


CupertinoTheme support

Great lib, very tempting.
Is CupertinoTheme support planned too?

Hi @smartyboy, there is no changes in Themes, you can use them as you want.
ex:
return MaterialApp(
    builder: OneContext().builder,
    navigatorKey: OneContext().key,
    ...
);

// or

return CupertinoApp(
    builder: OneContext().builder,
    navigatorKey: OneContext().key,
    theme: CupertinoThemeData(),
);

And navigation:
CupertinoPageRoute(builder: (_) => HomePage(), settings: settings);
// or
MaterialPageRoute(builder: (_) => HomePage(), settings: settings);


Update to proso-apps==1.2.13 fails on my Ubuntu machine

The error is the following:
$ pip install -r requirements.txt
Requirement already satisfied (use --upgrade to upgrade): dj-database-url==0.3.0 in /home/xstanis1/.virtualenvs/anatomy/lib/python2.7/site-packages (from -r requirements.txt (line 1))
Collecting proso-apps==1.2.13 (from -r requirements.txt (line 2))
Exception:
Traceback (most recent call last):
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/basecommand.py", line 211, in main
    status = self.run(options, args)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/commands/install.py", line 305, in run
    wb.build(autobuilding=True)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/wheel.py", line 705, in build
    self.requirement_set.prepare_files(self.finder)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/req/req_set.py", line 334, in prepare_files
    functools.partial(self._prepare_file, finder))
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/req/req_set.py", line 321, in _walk_req_to_install
    more_reqs = handler(req_to_install)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/req/req_set.py", line 491, in _prepare_file
    session=self.session)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/download.py", line 825, in unpack_url
    session,
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/download.py", line 673, in unpack_http_url
    from_path, content_type = _download_http_url(link, session, temp_dir)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/download.py", line 857, in _download_http_url
    stream=True,
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py", line 477, in get
    return self.request('GET', url, **kwargs)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/download.py", line 373, in request
    return super(PipSession, self).request(method, url, *args, **kwargs)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py", line 465, in request
    resp = self.send(prep, **send_kwargs)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py", line 573, in send
    r = adapter.send(request, **kwargs)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/adapter.py", line 36, in send
    cached_response = self.controller.cached_request(request)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/controller.py", line 102, in cached_request
    resp = self.serializer.loads(request, self.cache.get(cache_url))
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/serialize.py", line 108, in loads
    return getattr(self, "_loads_v{0}".format(ver))(request, data)
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/serialize.py", line 170, in _loads_v2
    cached["response"]["body"]
  File "/home/xstanis1/.virtualenvs/anatomy/local/lib/python2.7/site-packages/pip/_vendor/cachecontrol/serialize.py", line 20, in _b64_decode_bytes
    return base64.b64decode(b.encode("ascii"))
UnicodeEncodeError: 'ascii' codec can't encode character u'\u0133' in position 10650061: ordinal not in range(128)

However, it works on my Fedora machine

wow?

And today it just worked.


putFile crashes Safari on iOS when uploading many encrypted files.

I'm using the putFile to upload encrypted images to Gaia storage.
It works great on most platforms, but on iOS Safari if I try to upload a list of more than 3 images the browser often crashes and reloads the page. It works fine if I turn off encryption in the putFile method.
I analyst the memory usage and it spikes up to about 1 GB memory usage before crashing and these images is only around 2-MB in size.
Any ideas what the issue could be?
I'm using blockstack.js version 18.1.0 and tested on an iPhone 8, iOS 12.
The issue can be recreated by uploading images from an iPhone here: app.block-photos.com
The code I use to upload the images: https://github.com/nerdic-coder/block-photos/blob/master/src/services/PictureService.js#L60

@nerdic-coder I was able to upload 6 images at app.block-photos.com without encountering the problem.
I'm using iPhone XS max with 12.1.
Can you share console logs for your browser when the problem happens?

Can’t share to log since the browser crashes and the inspector as well.
Did you upload all 6 pictures at the same time?
I made a video with the issue here: https://youtube.com/watch?v=h3ObE25Bm7E&feature=youtu.be

This issue looks pretty bad. It looks like without encryption we use the appropriate APIs for upload-streaming content directly from disk (like an image) to the hub.
With encryption it looks like we make several in-memory copies of the content. At a cursory overview it looks like around 4 (😬!) copies. Probably more depending on implementation of the crypto APIs we pass the data through). Some of these copies are string/b64 encoding the binary data for a massive JSON object upload.
Potential steps to fix:

Use a crypto lib that will stream encrypt the data during upload. Need to investigate if the http upload APIs like fetch can do this. Otherwise we'd need to chunk it ourselves or something.
Use one of the json-streaming libs that exist for this purpose. Or use a binary format for encrypted data - although, json is nice for other devs/implementations not having to deal with parsing some binary format.

@kantai @yknl @hstove @larrysalibra Thoughts? If I have the bandwidth I'd be interested in taking this on.

@zone117x Any updates on this issue? I am using v19.1.0 and noticing that the encrypted data size is always ~4 times the actual size. Is there any way to work around this issue until we have a fix?

During the public weekly engineering two weeks ago, @zone117x indicated he’d made some progress on investigating more efficient encryption implementations. Will let him update us as to the exact status.

@zone117x should we assign this issue to you and move it into "In Progress" if you're investigating?


TODAY placeholder not localized

The placeholder TODAY in "last_updated_date_style" is always replaced by Date.today().strftime("%B %Y"). As it is not possible to call the setlocale function (see https://docs.python.org/3/library/locale.html) this funtions always returns an English string like "June 2024".
However it would be great if I could control the locale that is used via the yaml file so that this language matches my locale_catalog in the yaml.
Currently in the header it says for me now: "Zuletzt aktualisiert: June 2024" whereas the rest of the document and the dates are translated to German language by using my own locale_catalog.

Thank you for finding this! It will be available in the next release.

Yea. Sure. Happy you plan to integrate it!
Maybe there is a different or more elgant way as to call the setlocale function. I'm not sure. But I'm confident you will find a good way. I love your libraray. Thank you for the great work.

I like the full control over the PDF via the YAML file, so I ended up adding a new field to the locale_catalog field: full_names_of_months. From now on, it will pull TODAY's month name from there.
If you would like to test it, you can install RenderCV from the latest commit with the command below:
pip install "rendercv@git+https://github.com/sinaatalay/rendercv"

Yea. Thats really consistent with the other options. I like it! Test was successful. Thanks again!

This issue has been fixed with RenderCV v1.2.


prow.sh: collect cluster logs

We create at most two different clusters for each job, one with alpha
features enabled and one without. For both the logs of system
components are collected before tearing down the cluster and stored as
artifacts under "cluster-logs/[non-]alpha".
This is useful in particular for kubelet logs.
Fixes #55

/lgtm


Swashbuckle V2/V3 & File

Hi Guys!
In the V3 OpenApi file content definition has changed quote:
An API operation can return a file, such as an image or PDF. OpenAPI 3.0 defines file input/output content as type: string with format: binary or format: base64. ### This is in contrast with OpenAPI 2.0, which uses type: file to describe file input/output content. If the response returns the file alone, you would typically use a binary string schema and specify the appropriate media type for the response content:
I need V2 schema so I use:
                app.UseSwagger(x =>
                {
                    x.SerializeAsV2 = true;
                });

But Swashbuckle still generates:
        "responses": {
          "200": {
            "description": "Success",
            "schema": {
              "format": "binary",
              "type": "string"
            }
          }
        }

That basically brakes correct Autorest client generation.
And the sad thing is that I cannot find how could I fix this using filter.
Any advice would be really appreciated!
Thank you!

Just FYI problem seems to be solved with following filter:
    public class FileOperationFilter : IOperationFilter
    {
        public void Apply(OpenApiOperation operation, OperationFilterContext context)
        {
            if (context.ApiDescription.SupportedResponseTypes.Any(x =>
                x.Type == typeof(FileStreamResult) ||
                x.Type == typeof(FileResult)))
            {
                operation.Responses.First().Value.Content.First().Value.Schema.Type = "file";
            }
        }
    }

But as far as I understand it should be done automatically after serialize as V2 is turned on?

@yahorsi were you able to generate OAPI 3.0 in .Net itself and not .Net core?
The code base I am working on is based on .Net and uses Swashbuckle.core 5.6.0. It generates Swagger 2.0 doc by default. However, I need a way to convert it to OAPI 3.0 in the code itself. Is there a way to do so?
This is how my SwaggerConfig looks like:
[public class SwaggerConfig
{
public static void Register()
{
var thisAssembly = typeof(SwaggerConfig).Assembly;
  GlobalConfiguration.Configuration
      .EnableSwagger(c =>
      {
        c.SingleApiVersion("v1", "IT2 WebAPI Documentation");
        c.PrettyPrint();

        //To serialize enums as strings
        c.DescribeAllEnumsAsStrings();

        // Add authorization header
        //c.OperationFilter<AddRequiredAuthorizationHeaderParameter>();

        // Add default response for all endpoints
        c.OperationFilter<DefaultResponseFilter>();

        // Enable swagger custom attributes
        c.DocumentFilter<HideInSwaggerFilter>();
        c.OperationFilter<ApplySwaggerImplementationNotesFilterAttributes>();
        c.OperationFilter<ApplySwaggerOperationSummaryFilterAttributes>();

        // Enable swagger descriptions
        c.OperationFilter<ApplyDescriptionOperationFilterAttributes>();

        //Support to check required fields
        c.OperationFilter<UpdateParametersAsRequired>();

        // Enable swagger examples support
        c.OperationFilter<ExamplesOperationFilter>();

        // Set custom operationIds to make them unique based on HTTP method
        c.OperationFilter<SameOperationWithDifferentVerbFilter>();

        // Allow only specific Media types
        c.OperationFilter<SwaggerMediaTypesOperationFilter>();

        /* ***** To view fully qualified schema name on swagger UI ****
       c.UseFullTypeNameInSchemaIds();

       /* ***** To view the generated Swagger.json file ****
        * would have to Add a reference to  YamlDotNet from .Nuget package manager *** */
        //c.DocumentFilter<YamlDocumentFilter>();

        /* ***** Add Comments from XML documentation ****
          * Turn on XML documentation in Project properties *** */

<EMAIL_ADDRESS>AppDomain.CurrentDomain.BaseDirectory));
<EMAIL_ADDRESS>AppDomain.CurrentDomain.BaseDirectory));

      })
      .EnableSwaggerUi(c =>
      {
        c.DocumentTitle("IT2 WebAPI Documentation");
        //TODO : CSS to overwrite the default swagger UI
        //c.InjectStylesheet(typeof(SwaggerConfig).Assembly, "ServiceHost.Swagger.SwaggerHeader.css");
      });
}

}](url)


Tailwind config for M3ntroship theme

Story
we need to add the proper tailwind config to match the tokens as per the design figam
Prerequisites

#2 create project setup
#1 integrating tailwindcss

Tasks
After we receive (to be attached) a json file contains all tokens configuration, use it to generate the proper config
Acceptance criteria
Tailwindcss classes should be generated according to the deisgn

@elhaw I think the project is ready for this task despite the full project setup task hadn't done yet but you can integrate tailwind and add it's config in parallel


fix(frontend): Emit user activation event if it is SaaS only

End-user friendly description of the problem this fixes or functionality that this introduces

[ ] Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below

Give a summary of what the PR does, explaining any non-trivial design decisions

Link of any specific issues this addresses

To run this PR locally, use the following command:
docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:bf968a2-nikolaik   --name openhands-app-bf968a2   docker.all-hands.dev/all-hands-ai/openhands:bf968a2

Unnecessary


hybrid_engine: check tuple size when fusing lora params

As written, I believe the if conditions might always evaluate to True, since the body of the for loop would not execute if the lora_params list is 0-length.  I think the intent here was to verify that the tuple has three elements.

@tjruwase , here is a PR for the lora_param question.


How to add direction mark in WebVR?

Can Marzizano implement functions like WebVR in Krpano?
https://krpano.com/releases/1.20.8/viewer/krpano.html?xml=examples/demotour-stereoscopic/tour.xml&html5=webgl+only
Enter the next interface through the contact direction identification of left and right eye center points.

Can you further elaborate what you mean? It is pretty unclear for me. What exact function is in Krpano, and is missing in Marzipano? What is the "contact direction identification"? The big arrow point up to the roof?

Yes, How to add the big arrow in Marzipano for WebVR Model?


Still safe?

Is it still safe to use bloxstrap? Since everyone now has 64bit and if you keep the channel in Live (32-Bit), will your account be at risk?
I just want to know if bloxstrap will still work and not get me banned.

Nah

No, since still being able to use 32-bit is an intentional thing by Roblox.


Allow template slot option for purely text content

What problem does this feature solve?
Simpler to understand
What does the proposed API look like?
<template slot="description" text="content here"/>

Equivilant of:
<template slot="description">content here</template>

Thanks for the proposal but this brings very little benefit while being less flexible and adding an extra thing to learn. It can also be achieved through a string-based prop

Thanks for the feedback


Update instructor_ex.py - fix typo

Fix minor typos in instructor_ex.py docstring
And thanks for making ell, great tool for prompt engineering ❤ !

THANK YOU!


⚠ Jenkins Plugins Artifactory has degraded performance

In d51c292, Jenkins Plugins Artifactory (https://get.jenkins.io/plugins/artifactory/) experienced degraded performance:

HTTP code: 200
Response time: 1225 ms

Resolved: Jenkins Plugins Artifactory performance has improved in 4e0dd3b after 5 hours, 53 minutes.


Include unzip command

I use the layer to perform some boilerplate actions in CodePipeline. One of my usecases is that I need to unzip a BuildArtifact provided by CodeBuild. This artifact is zipped (not gzipped or a tarball), so with this layer I cannot unzip it.
Since the zip command is present, could you also include the unzip command?

I just noticed that the unzip command is already included in the layer, but just not listed in the README. So I've created a PR for this: https://github.com/gkrizek/bash-lambda-layer/pull/57


updated function names for profile processing

Some of the function names of hte function used for profile processing did not adhere to the julia standard. This PR should fix that.

The failing tests are related to a failed download of data from ISC. This often happens if there are multiple requests, as their bandwidth is quite limited. To solve this, we could add the XML file we usually download to the repository. Or we just ignore the error for the time being.

So I was unsure about this, as ProfileData is a Julia structure which can/should have camel names

Adding the XML is probably a bad idea, as the size of the repo will increase with every PR.... How large is this downloaded file? could the test be done with a much smaller one?

The failing tests are related to a failed download of data from ISC. This often happens if there are multiple requests, as their bandwidth is quite limited. To solve this, we could add the XML file we usually download to the repository. Or we just ignore the error for the time being.

or you rerun the failing tests

So I was unsure about this, as ProfileData is a Julia structure which can/should have camel names, so I thought that extract_ProfileData is acceptable in that case

That is also a good point.

Adding the XML is probably a bad idea, as the size of the repo will increase with every PR.... How large is this downloaded file? could the test be done with a much smaller one?

As the download instructions are quite restrictive in space, time and magnitude, only the information of a single earthquake is downloaded, which amounts to a file size of 3 KB. I guess we could live with that. And then we don't spam the ISC with repeating downloads...

I'd suggest to keep extract_ProfileData as a function name, but to change the others.

Adding the XML is probably a bad idea, as the size of the repo will increase with every PR.... How large is this downloaded file? could the test be done with a much smaller one?

As the download instructions are quite restrictive in space, time and magnitude, only the information of a single earthquake is downloaded, which amounts to a file size of 3 KB. I guess we could live with that. And then we don't spam the ISC with repeating downloads...

I guess 3Kb is acceptable :)

As the last test has now repeatedly failed due to download issues, I'd just merge it.


BUG: DBClassName should upgrade legacy class names

A regression from the table_name feature is now that, where class != table name, there could be legacy values in the ClassName field in tables which refer to the table, where these should be the class.
DBClassName::require_field should probably automatically upgrade field values which match table names (but not class names) so that they refer to the class name.
E.g. ChangeSet should be updated to SilverStripe\ORM\Versioning\ChangeSet

I've posted a fix for this at #5840.

Looks like we can close this one!


Prevent drag and drop causing redirect

Fix for issue #364

Good catch on being safe and removing the listeners on unmount.
IMO there's no need for two functions that do the same thing, nor is there a reason for that function to live within the React class. There's no reason to use this.someFunction() if someFunction doesn't actually need to know about this
const preventDefault = e => e.preventDefault(); at the top of the file, outside the scope of the class and
  componentDidMount() {
    this.props.dispatch(ConfigActions.loadConfig());
    document.addEventListener('dragover', preventDefault, false);
    document.addEventListener('drop', preventDefault, false);
  }

  componentWillUnmount() {
    document.removeEventListener('dragover', preventDefault, false);
    document.removeEventListener('drop', preventDefault, false);
  }

is cleaner imo

Oh yes, I missed that. Thanks, I will change that now.

Thanks for the CR @s-kem. Did you check it is working? I will merge it if you approve that.


app_installer supports formats APKs, APKm, xAPK?

app_installer supports formats APKs, APKm, xAPK?

There is no plan to support at the moment, if you can write related functions, welcome to add PR


Data bag create in infra views allows for invalid names

Describe the bug
Data bag names are validated under the hood to prevent invalid names from being saved. It doesn't appear that Automate is performing this validation and instead fails with a cryptic message to the user.
To Reproduce
Steps to reproduce the behavior:

Click the infrastructure tab
Click Chef Infra Servers
Select your server
Select your org
Select data bags
Select Create Data Bag
Enter name with space like "foo bar"

Expected behavior
I should get a validation error directly in the modal that explains what values are allowed
Screenshots
Error thrown post create:

CLI behavior that is still terrible:

Versions (please complete the following information):

OS: macOS
Browser Firefox
Automate Build Number<PHONE_NUMBER>0302

We are facing this issue inside every create modal (Role/ Environment/ Client/ Data bag/ Data bag item ) so we have already created this issue and working on that #4960


stop changeSlide if carousel is hidden

fixes the 2nd part of https://github.com/zurb/foundation-sites/issues/9103
motion-ui finish method is not called if the element is hidden (or inside hidden elements).
Therefore if changeSlide() is called for hidden carousels the "is-active" class attribute will be set for the next/chosen slide but mui-transition classes will be not removed from current/next slide. Further changeSlide() calls will therefore exit early as mui-classes are found in the current  lide (= the previous transition's next/chosen slide).

Hmm... so I think I understand the problem this is trying to fix, but I'm not sure this is the right fix.
My understanding is that running the full transition breaks if the carousel is hidden, leaving the carousel in a broken state, so this prevents that by preventing a transition if the carousel is hidden.
However, it seems plausible to me that someone would want to want to change the slide to set it to something while it was hidden before showing it again.  Can we instead address this by in the hidden case changing the active slide without going through the transitions?

That would be event better. My fix was the quickest idea that came to my mind to prevent the broken motion-ui transition while being hidden, but I believe that a definitve fix should address the motion-ui lib.
Your idea of just stopping the transition, leaving the ability of setting the active slide is in my opinion a step further, so, i agree, it would be better than my quick fix.
kind regards

closing in favor of THE appropriate fix https://github.com/zurb/foundation-sites/issues/9311


[SUPPORT] Spark empty dataframe problem

Hello Guys,
I have a pipeline that reads csv file and writes to Hudi, much simple. The csv files are from an external application, yesterday I realized that the application creates a csv file even if has no data, so my pipeline read an empty csv and writes to Hudi, because of that, my tables have a lot of empty commits and all my parquet files disappeared.
20210311130632.commit.zip

Am I have to put an empty dataframe validation in my pipe?
Thank you so much

@rubenssoto : how do you write to hudi? Do you use delta streamer or do you your own spark job that writes to hudi directly?
Also, what do you mean by "all my parquet files disappeared." ? Do you mean to say, due to cleaning, your files are disappeared? I don't quite get this.
Also, I assume this empty dataframe is not a one off thing, but its happens regularly w/ your pipeline and hence you wish to see what's the best way forward.

Hello @nsivabalan
Im using my own spark job, yeah I think because of cleaning all my parquet files were gone.
Yeah that's it, we are ingesting data from an application called AppsFlyer, they send CSV files each hour, but when they don't have data to send, they send empty csv files with columns only.

got it. thanks.
if checkpointing is not an issue, I would suggest to filter out at your end and avoid writing to hudi to make it easy.

What do you mean by "checkpointing"?

never mind. If you can filter and avoid doing empty commits on your end, that would be nice.

Thank you, I will try if necessary I open this issue again, thank you

thanks!


issues while pushing firehose_exporter

Hi
I've cloned the app & updated the manifest.yml as below
  - name: firehose-exporter
    buildpack: go_buildpack
    env:
      FIREHOSE_EXPORTER_UAA_URL: "<URL>"
      FIREHOSE_EXPORTER_UAA_CLIENT_ID: "<CLIENT_ID>"
      FIREHOSE_EXPORTER_UAA_CLIENT_SECRET: "<CLIENT_SEC>"
      FIREHOSE_EXPORTER_DOPPLER_URL: "<url>"

and tried to push the app, with cf push.  I get the error :
       **ERROR** To use go native vendoring set the $GOPACKAGENAME
       environment variable to your app's package name
       **ERROR** Unable to determine import path: GOPACKAGENAME unset

I've updated the manifest file with the env variable entry GOPACKAGENAME: firehose and tried pushing again. This time a different error.
**WARNING** Installing package '.' (default)
-----> Running: go install -tags cloudfoundry -buildmode pie .
firehose_exporter.go:13:2: cannot find package "github.com/bosh-prometheus/firehose_exporter/collectors" in any of:
        /tmp/gobuildpack.gopath011202497/.go/src/firehose/vendor/github.com/bosh-prometheus/firehose_exporter/collectors (vendor tree)
        /tmp/contents418976151/deps/0/go1.8.3/go/src/github.com/bosh-prometheus/firehose_exporter/collectors (from $GOROOT)
        /tmp/gobuildpack.gopath011202497/.go/src/github.com/bosh-prometheus/firehose_exporter/collectors (from $GOPATH)
firehose_exporter.go:14:2: cannot find package "github.com/bosh-prometheus/firehose_exporter/filters" in any of:
        /tmp/gobuildpack.gopath011202497/.go/src/firehose/vendor/github.com/bosh-prometheus/firehose_exporter/filters (vendor tree)
        /tmp/contents418976151/deps/0/go1.8.3/go/src/github.com/bosh-prometheus/firehose_exporter/filters (from $GOROOT)
        /tmp/gobuildpack.gopath011202497/.go/src/github.com/bosh-prometheus/firehose_exporter/filters (from $GOPATH)
firehose_exporter.go:15:2: cannot find package "github.com/bosh-prometheus/firehose_exporter/firehosenozzle" in any of:
        /tmp/gobuildpack.gopath011202497/.go/src/firehose/vendor/github.com/bosh-prometheus/firehose_exporter/firehosenozzle (vendor tree)
        /tmp/contents418976151/deps/0/go1.8.3/go/src/github.com/bosh-prometheus/firehose_exporter/firehosenozzle (from $GOROOT)
        /tmp/gobuildpack.gopath011202497/.go/src/github.com/bosh-prometheus/firehose_exporter/firehosenozzle (from $GOPATH)
firehose_exporter.go:16:2: cannot find package "github.com/bosh-prometheus/firehose_exporter/metrics" in any of:
        /tmp/gobuildpack.gopath011202497/.go/src/firehose/vendor/github.com/bosh-prometheus/firehose_exporter/metrics (vendor tree)
        /tmp/contents418976151/deps/0/go1.8.3/go/src/github.com/bosh-prometheus/firehose_exporter/metrics (from $GOROOT)
        /tmp/gobuildpack.gopath011202497/.go/src/github.com/bosh-prometheus/firehose_exporter/metrics (from $GOPATH)
firehose_exporter.go:17:2: cannot find package "github.com/bosh-prometheus/firehose_exporter/uaatokenrefresher" in any of:
        /tmp/gobuildpack.gopath011202497/.go/src/firehose/vendor/github.com/bosh-prometheus/firehose_exporter/uaatokenrefresher (vendor tree)
        /tmp/contents418976151/deps/0/go1.8.3/go/src/github.com/bosh-prometheus/firehose_exporter/uaatokenrefresher (from $GOROOT)
        /tmp/gobuildpack.gopath011202497/.go/src/github.com/bosh-prometheus/firehose_exporter/uaatokenrefresher (from $GOPATH)
       **ERROR** Unable to compile application: exit status 1
Failed to compile droplet: Failed to run finalize script: exit status 12
Exit status 223
Staging failed: STG: Exited with status 223
Stopping instance f410bee9-d644-408c-adf5-117702d74412
Destroying container
Successfully destroyed container

Could someone please let us know what's going on and how do we fix it ?
Thanks in advance.

Can you please try setting the GOPACKAGENAME to github.com/bosh-prometheus/firehose_exporter?
The  go buildpack only detects dep dependencies starting at v1.8.9, so my guess is that you're using an older buildpack version. If that's the case, the GOPACKAGENAME env var must be set with the name of the package name (in this case, the github repo name).

Thanks for the reply @frodenas
I've tried after adding GOPACKAGENAME. Failed again with similar error :
-----> Running go build finalize
       Note: skipping (dep ensure) due to non-empty vendor directory.
       **WARNING** Installing package '.' (default)
-----> Running: go install -tags cloudfoundry -buildmode pie .
Exit status 0
Staging complete
Uploading droplet, build artifacts cache...
Uploading build artifacts cache...
Uploading droplet...
Uploaded build artifacts cache (216B)
Uploaded droplet (16.1M)
Uploading complete
Stopping instance d9e7780a-1278-4ac1-9d2a-5a04b1c8612d
Destroying container
Successfully destroyed container

0 of 1 instances running, 1 crashed
FAILED
Error restarting application: Start unsuccessful

I've pushed using the command cf push -b https://github.com/cloudfoundry/go-buildpack.git

This seems to be a different error. The first one reported was about not being able to stage the application. The latter one seems that the application has been staged but it's not started successfully. Have you tried to run cf logs <app-name> --recent to see if there's any error log?

error: required flag --metrics.environment not provided means you need to provide that flag, via Procfile or via the FIREHOSE_EXPORTER_METRICS_ENVIRONMENT environment variable.

Thanks alot @frodenas . This time it went through.
But, we are not getting a firehose-specific metrics, just the default metrics from the exporter. The logs shows errors like :
   2018-02-19T13:25:55.61+0100 [APP/PROC/WEB/0] ERR time="2018-02-19T12:25:55Z" level=error msg="Error getting oauth token: Received a status code 404 Not Found. Please check your Client ID and Secret." source="uaa_token_refresher.go:39"
   2018-02-19T13:25:55.61+0100 [APP/PROC/WEB/0] ERR time="2018-02-19T12:25:55Z" level=error msg="Error while reading from the Firehose: Received a status code 404 Not Found" source="firehose_nozzle.go:111"
   2018-02-19T13:25:59.63+0100 [APP/PROC/WEB/0] ERR time="2018-02-19T12:25:59Z" level=error msg="Error getting oauth token: Received a status code 404 Not Found. Please check your Client ID and Secret." source="uaa_token_refresher.go:39"
   2018-02-19T13:25:59.63+0100 [APP/PROC/WEB/0] ERR time="2018-02-19T12:25:59Z" level=error msg="Error while reading from the Firehose: Received a status code 404 Not Found" source="firehose_nozzle.go:111"

But I'm sure CLIENT_ID/SECRET that I've mentioned in the manifest.yml is valid and I'm able to authenticate using uaac token client get CLIENT_ID -s SECRET. Secret doesn't have any special character.

There're 2 things to check:

The client ID has the right permissions as outlined at the README
If you're using self-signed certificates, you're setting the FIREHOSE_EXPORTER_SKIP_SSL_VERIFY to true

@frodenas
Thank you. But,CLIENT_ID has right permissions as mentioned in the README.
ubuntu@bosh-stemcell:~$ uaac context

[1]*[https://uaa.sys.adp.allianz]
  skip_ssl_validation: true

  [2]*[prometheus-firehose]
      client_id: prometheus-firehose
      access_token: <token>
      token_type: bearer
      expires_in: 43199
      scope: doppler.firehose
      jti: 6bff49756e80466783532ff740ee2d7f

manifest.yml
applications:
  - name: firehoseexporter
    buildpack: go_buildpack
    env:
      GOPACKAGENAME: github.com/bosh-prometheus/firehose_exporter
      FIREHOSE_EXPORTER_SKIP_SSL_VERIFY: true
      FIREHOSE_EXPORTER_METRICS_ENVIRONMENT: prod
      FIREHOSE_EXPORTER_UAA_URL: "https://uaa.<domain>/"
      FIREHOSE_EXPORTER_UAA_CLIENT_ID: "prometheus-firehose"
      FIREHOSE_EXPORTER_UAA_CLIENT_SECRET: "pwd"
      FIREHOSE_EXPORTER_DOPPLER_URL: "wss://doppler.<domain>:443"

Still getting the same error as previous comment.

Try ssh'ing into the firehoseexporter container and do a curl to your uaa and doppler endpoints. Maybe there's a proxy or ASG preventing the container to access those endpoints.

Unfortunately, it looks like wss is not supported.
vcap@72fee689-c1ed-42a7-607c-de2a:~$ curl -i  "wss://doppler.sys.adp.allianz:443"
curl: (1) Protocol wss not supported or disabled in libcurl

uaa:
vcap@72fee689-c1ed-42a7-607c-de2a:~$ curl -i https://uaa.sys.adp.allianz -k
HTTP/1.1 302 Found
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Length: 0
Date: Wed, 21 Feb 2018 08:29:36 GMT
Expires: 0
Location: https://uaa.sys.adp.allianz/login
Pragma: no-cache
Set-Cookie: X-Uaa-Csrf=2JTLG89YRbPAiXes3y6CU7; Max-Age=2592000; Expires=Fri, 23-Mar-2018 08:29:37 GMT; Secure; HttpOnly
Set-Cookie: JSESSIONID=A2BA57ECB6B89D751A3E3C9434122FB0; Path=/; Secure; HttpOnly
Set-Cookie: __VCAP_ID__=22bec785-a57b-4774-5ac7-6ae4b45381e3; Path=/; HttpOnly; Secure
Strict-Transport-Security: max-age=31536000 ; includeSubDomains
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Vcap-Request-Id: 6375d0fe-dd70-4c5c-40dc-288d2b8ba5e0
X-Xss-Protection: 1; mode=block

Are you using a proxy? if yes, is possible that the proxy does not support wss protocols?

Hi @frodenas
Yes, we use proxy. But same results even when I ignore the proxy...
vcap@72fee689-c1ed-42a7-607c-de2a:~$ curl --noproxy '*' "wss://doppler.<domain>:443"
curl: (1) Protocol wss not supported or disabled in libcurl

:(

That's unrelated, the problem with that curl command is that does not support wss. Is there any way you can run the exporter without a proxy to test if this is the problem?

@frodenas  Sorry for the confusion..
Actually, the container and the doppler are in same network. So, there is no need of proxy.

try removing the trailing slash at FIREHOSE_EXPORTER_UAA_URL: "https://uaa.<domain>/" please. This slash was causing some problems at the cf_exporter (see https://github.com/bosh-prometheus/cf_exporter/issues/22)


How to setup or run your project?

hi dear author:
Could you give an instruction to show how to run your project please?
Thanks.

Yes, we are kind of working on a small tutorial. We though of Jupyter notebooks to showcase the examples but are unsure about mixture files we can officially share. Would you like to share what you want to run first? Then we can prepare that example first.

Dear @zcy618,
Christoph has now created a toy example here: https://github.com/fgnt/pb_bss/blob/master/examples/mixture_model_example.ipynb
You can run the notebook locally after installing this package with the following code:
git clone git@github.com:fgnt/pb_bss.git
cd pb_bss
pip install -e .

Let us know if you encounter any errors.


Adds gbridge call notification and refactor widget

The current gbridge Android app already sends call notifications. This change just adds notifications for  incoming calls.
I refactored the widget to be more readable, please have a critical look on my code as I am not very experienced with js.

Thanks! It looks good - it's nice having the global drawContent function to handle all different notifications.
Just because we're on a device without too many resources (and gadgetbridge is running in the background with other apps in the foreground), there are a few things that I'm not sure are a good idea...
Basically, on Bangle.js function code is stored and executed from Flash memory, so doesn't use any RAM. Stuff that does use RAM is any variables/objects (even const) and each function declaration (just not the code in it).

Stuff like musicState.STOP is defined and used once. It makes it harder to see what the code is actually checking against, but it's using extra RAM in order to store the whole musicState structure. I guess if we moved to minification then the minifier would undo that for us though.
I wonder about making the images external vs. inline, especially for small ones? I know it does make code a little more readable, but where it's only ~100 bytes of code I'm not sure if it's really that much of a win, as having to search for and load another file first slows things down

There's another PR (https://github.com/espruino/BangleApps/pull/130) for handling fullscreen notifications which abstracts stuff in a similar way, and I think perhaps this would be a good time to actually split Gadgetbridge up - having the main gadgetbridge handling just the decoding, with another (choosable) app handling how those notifications are displayed.
I'll leave this and the other PR open until I get a moment to merge both

Specifically: https://github.com/espruino/BangleApps/issues/162

Thanks for your time!
I wasn't aware that the variable declarations are affecting the RAM usage so much. I will look into this in the next days.

I inlined the variables again and restored most of the notification code. That should make it easier to integrate it with the other PRs.

Thanks for this! Just merged.


No module named procedures

Hi, I am trying your new architecture (angr-bf). I wanna feel new experience.
Unfortunately, I got an error like this :
Traceback (most recent call last):
File "findflagsolver.py", line 5, in
from angr_bf import arch_bf, load_bf, simos_bf
File "/home/f000/.virtualenvs/aegg/local/lib/python2.7/site-packages/angr_bf/simos_bf.py", line 2, in
from angr.procedures import SIM_PROCEDURES as P, SIM_LIBRARIES as L
ImportError: No module named procedures
There is no module named procedures. I even have updated angr to the newest version.
I don't know how to solve it. Can you explain to me how to fix this ?
Thank you.

Hello! angr is currently going through a big refactor that will culminate in a major version release. this version of the repository has been updated with the new APIs, and is as such incompatible with the version of angr currently on pip. If you want to get this working you should either install angr via the angr-dev Github repository (just a setup script to pull all the repositories from Github basically) or check out an older version of this repo from before the refactor began.

Ow, I see. Ok, I will try it. Thank you for your answer. :+1:


Configure Plek for Content Tagger on AWS

This should fix issues where Collections Publisher links to Content
Tagger using the internal domain.

I've been working on a more general approach since I put this up, so closing in favour of fixing this via https://github.com/alphagov/collections-publisher/pull/308


[1.8.10] Removed leader.mesos prerequisite for dcos-mesos-slave(-public).

High Level Description
Since DC/OS 1.8+ agents do not depend on leader.mesos (e.g. we can start a dcos-mesos-slave with --master=zk1:2181), we should not have this prerequisite for the services dcos-mesos-slave and dcos-mesos-slave-public as it can result in outages.
This PR is a backport of #1921 for DC/OS 1.8.

We need a comment about the smoke-test/dcos-docker failure.

Ticket created: https://jira.mesosphere.com/browse/DCOS_OSS-1672

Re-running the dcos-docker/smoke-test again. Failed here: https://teamcity.mesosphere.io/viewLog.html?buildId=792699

The dcos-docker/smoke-test reproducibly fails here. @gabrielhartmann @benclarkwood can we ignore that / is that expected or does that need to be fixed?

Yes, our smoke test will not pass in 1.8 as we require 1.9 or newer.
Cc @mellenburg

@mesosphere-mergebot bump-ee

The EE failures are the due mesos-modules-private commit being incorrectly referenced from an non-existing branch (of mesos-modules-private repo).
This can fixed, and I will try patch the mergebot created EE branch with the fix.


Model being a mess of colors/triangles

Hello, I'm trying to import a model of an arcade cabinet into GameMaker. On the left is how it appears in Blender, and on the right is in GameMaker and something is clearly wrong with it. The model being upside down is an easy fix, but what's going on with the mess of triangles/colors here?! I assume it has something to do with me not exporting the .vb file correctly? I've been trying for hours to figure it out but I don't know what's going on, please help

What is the format of the vertex buffer you're using (Blender and gms)?

In Gamemaker this is the format being defined in the create event

In blender for the format I tried exporting it changing around the number of floats for position and colorbytes but I get this runtime error (not sure why)

To make this easier here are the files: https://drive.google.com/file/d/1ytsflteKj3WsgdImdkGoPwkTltWHmFhA/view?usp=sharing

@Grisgram Thanks for the reply. I just redownloaded the latest version, and I read your thread and tried applying what @Sandman13sq said to do for the export, but am still getting the mess of colorful triangles. This has gotta be me screwing something up on my end...
Here are the specific settings I did when I exported:
I select my mesh, add a color attribute (Domain: Face Corner, Data Type: Byte Color), and go back to Scene where I have a format with Position, Color Bytes (RGBA), and UVs. (The format is: POSITION3 COLORBYTES4@"Color" UV2@"UVMap"). Then I export as a .vb file.
Yet I'm still getting the colorful triangle mess... what specific setting am I messing up? Help!!!

Make sure the format you create in GMS matches the content and order of the one you have in Blender. Your format has more entries than necessary.

@Sandman13sq That fixed the problem, thank you so much!
One more question though — as seen here the model is coming out as one whole color (or one whole texture if I use "sprite_get_texture(sprite,0)" in vertex_submit).

How would I make each part of the exported mesh different colors? So for example in the original image for the model I sent, the body of the arcade cabinet would be purple, the screen would be black, the buttons are yellow, joystick would be red, etc.
Is it something to do with adding color attributes? But then how would I apply said color attributes to only a specific part of the mesh? Just need to know how to accomplish this and I should be good to go.

as far as i can tell, you will get a unique-colored model in gamemaker unless you use textures and uv mappings. maybe i am wrong, but that's what i can see in the tutorial project

Grisgram Yeah that seems like the case. Luckily you can export as a collection so that you can still add different color attributes to the model as a whole, just not the specific parts within a combined mesh (I don't think atleast). That's not too important though. That being said, this add-on is awesome and thank you Sandman13sq !!!! LIKE SERIOUSLY THIS IS THE BEST PLUG IN EVER SO MUCH THANK YOUU!!!! You deserve an award


K Largest Element using Heap in cpp

In this, I have explained how we can find the k largest elements using heap (Priority queue in STL) with

Clean Code
Useful comments

@1dharode Please review my contribution and provide me with needful changes,


Add certificate expiration date

It's available in ssllabs response, how about exposing it as well, so that one could trigger an alert if a certificate for some reason hasn't been renewed.

BlackBox Exporter already provides this feature. You can check https://www.robustperception.io/get-alerted-before-your-ssl-certificates-expire as an example.

BlackBox Exporter already provides this feature. You can check https://www.robustperception.io/get-alerted-before-your-ssl-certificates-expire as an example.


web_login_background: redirection doesn't work

All versions has to be fixed

Fixed: https://github.com/it-projects-llc/website-addons/commit/5689cfe5e8f348073a274581b515766afdb04817#diff-c68addd3adb3b9fa452de7619dba8412


There is no migration provided

Hi,
I installed this gem but I get an error about the column missing
ActiveRecord::StatementInvalid (PG::UndefinedColumn: ERROR:  column users.authentication_token does not exist
Is there no DB migration for this gem?
Thanks,
Kavita

Resolved this by following 2 steps->
rails g migration add_authentication_token_to_users "authentication_token:string{30}:uniq"
rake db:migrate


[SMALLFIX] Minor changes in several files

Used automatic resource management in RemoteBlockInStream
Fixed link in Javadoc in UnderStoreBlockInStreamTest
Used <> generics in IndexedSet
Removed standalone Javadoc snippet in AlluxioException
Simplified check in DataNettyBuffer

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/11160/
Test PASSed.

Merged build finished. Test PASSed.

@HorizonNet thanks for the PR, left one minor comment, otherwise LGTM

@jsimsa Thanks for the comment. Another project messed with my settings. I updated the PR accordingly.

Merged build finished. Test PASSed.

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Alluxio-Pull-Request-Builder/11173/
Test PASSed.

LGTM


If content of element is replaced, a second .ellipsis() fails due to existing/wrong .data('jqae')

If the content of an 'ellipsed' element is replaced, a second .ellipsis() on the element fails due to existing/wrong .data('jqae') internal storage of autoellipsis.
Scenario:

div.mydiv gets some content via .html( "lorem ipsum 1 long longer longest etc." )
$( '.mydiv' ).ellipsis() is called
content is 'ellipsed' ok, fine
div.mydiv is cleared with $( '.mydiv' ).empty()
div.mydiv gets new content via .html( "lorem ipsum 2 even longer or shorter or etc." )
$( '.mydiv' ).ellipsis() is called
content is not 'ellipsed', not as expected

The problem is that .empty() does (of course) not clear the .data( 'jqae' ) of div.mydiv and so the second call to $( '.mydiv' ).ellipsis() finds it and draws wrong conclusions.
Workaround, clear the .data('jqae') internal storage of autoellipsis before second call:

$( '.mydiv' ).data( 'jqae', null )
$( '.mydiv' ).ellipsis() is called
content is 'ellipsed' ok, fine

Thanks for this great plugin.

Isn't this a Duplicate of #18, and still not fixed?


Quiz-list-component issue

I am experiencing a problem with the quiz list. It does not seem to like either one of the following:
import { HttpClient } from '@angular/common/http';
to
import { HttpClientModule } from '@angular/common/http';
I get a build error for both.  Went to the Google docs and it looks like the bottom is correct. But I am still getting errors. Appreciate a solution so I can continue.

Double check your app.module.shared file:
import { CommonModule } from '@angular/common';
import { FormsModule } from '@angular/forms';
import { HttpClientModule } from '@angular/common/http';

And also verify you have these entries in your package.json file:
    "@angular/common": "5.0.2",
    "@angular/compiler": "5.0.2",
    "@angular/compiler-cli": "5.0.2",
    "@angular/core": "5.0.2",
    "@angular/forms": "5.0.2",
    "@angular/http": "5.0.2",

Different versions, which may or may not work.

I am getting the error in both the app.module.shared.ts file as well as the
quiz-list.component.ts file. I have updated the entries you listed in the
package .json file as well.  I am not sure where else to go from here.
On Sat, Apr 7, 2018 at 6:29 PM, Joel Tipke<EMAIL_ADDRESS>wrote:

Double check your app.module.shared file:
import { CommonModule } from '@angular/common';
import { FormsModule } from '@angular/forms';
import { HttpClientModule } from '@angular/common/http';
And also verify you have these entries in your package.json file:
"@angular/common": "5.0.2",
"@angular/compiler": "5.0.2",
"@angular/compiler-cli": "5.0.2",
"@angular/core": "5.0.2",
"@angular/forms": "5.0.2",
"@angular/http": "5.0.2",

Different versions, which may or may not work.
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/PacktPublishing/ASP.NET-Core-2-and-Angular-5/issues/28#issuecomment-379506498,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AarBqe3mR7nCyBT-9JTx7mDGfbMgGNswks5tmUvIgaJpZM4TLNKw
.

Hello,  When I start Chapter 3 page 113  Testing up,  I receive the following errors:
ERROR in ./node_modules/bootstrap/dist/js/bootstrap.js
Module not found: Error: Can't resolve 'popper.js' in 'D:\MVC\TestMakerFree\TestMakerFreeWebApp\node_modules\bootstrap\dist\js'
@ ./node_modules/bootstrap/dist/js/bootstrap.js 7:100-120
@ ./ClientApp/boot.browser.ts
@ multi event-source-polyfill webpack-hot-middleware/client?path=__webpack_hmr&dynamicPublicPath=true ./ClientApp/boot.browser.ts
ERROR in ./ClientApp/boot.browser.ts
Module not found: Error: Can't resolve 'zone.js' in 'D:\MVC\TestMakerFree\TestMakerFreeWebApp\ClientApp'
@ ./ClientApp/boot.browser.ts 2:0-17
@ multi event-source-polyfill webpack-hot-middleware/client?path=__webpack_hmr&dynamicPublicPath=true ./ClientApp/boot.browser.ts
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:10:5
TS2564: Property 'selectedQuiz' has no initializer and is not definitely assigned in the constructor.
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:11:5
TS2564: Property 'quizzes' has no initializer and is not definitely assigned in the constructor.
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:15:14
TS2339: Property 'http' does not exist on type 'QuizListComponent'.
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:15:46
TS7006: Parameter 'result' implicitly has an 'any' type.
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:15:83
TS7006: Parameter 'error' implicitly has an 'any' type.
Can you help me.   Thank you in advance.

What is the actual error you are getting?

I'm getting several errors:
ERROR in ./node_modules/bootstrap/dist/js/bootstrap.js
Module not found: Error: Can't resolve 'popper.js' in 'D:\MVC\TestMakerFree\TestMakerFreeWebApp\node_modules\bootstrap\dist\js'
@ ./node_modules/bootstrap/dist/js/bootstrap.js 7:100-120
@ ./ClientApp/boot.browser.ts
@ multi event-source-polyfill webpack-hot-middleware/client?path=__webpack_hmr&dynamicPublicPath=true ./ClientApp/boot.browser.ts
ERROR in ./ClientApp/boot.browser.ts
Module not found: Error: Can't resolve 'zone.js' in 'D:\MVC\TestMakerFree\TestMakerFreeWebApp\ClientApp'
@ ./ClientApp/boot.browser.ts 2:0-17
@ multi event-source-polyfill webpack-hot-middleware/client?path=__webpack_hmr&dynamicPublicPath=true ./ClientApp/boot.browser.ts
ERROR in [at-loader] ./ClientApp/app/components/quiz/quiz-list.component.ts:10:5

This is the error from the stack I am receiving:
NodeInvocationException: Prerendering failed because of error: Error: Cannot find module "@angular/common/http" at Object. (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:17219:7) at webpack_require (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:20:30) at Object.hasOwn (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:15294:77) at webpack_require (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:20:30) at Object. (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:17345:81) at webpack_require (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:20:30) at C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:66:18 at Object. (C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp\ClientApp\dist\main-server.js:69:10) at Module._compile (module.js:649:30) at Object.Module._extensions..js (module.js:660:10) Current directory is: C:\Users\1801\source\repos\TestMakerFree\TestMakerFreeWebApp

Hello there and thank you for purchasing the book.
Did you try to download the GitHub code  (without modifying it) and see if it builds that way? It could be an issue with some newer versions of the various NPM packages used.

Hello,  with GitHub, as I downloaded, it works.   I  upgraded packages (i.e. Angular 5.2.9, and others also), but the result is with errors.  Here is package.json file content:
{
"name": "TestMakerFreeWebApp",
"private": true,
"version": "0.0.0",
"scripts": {
"test": "karma start ClientApp/test/karma.conf.js"
},
"devDependencies": {
"@angular/animations": "5.2.9",
"@angular/common": "5.2.9",
"@angular/compiler": "5.2.9",
"@angular/compiler-cli": "5.2.9",
"@angular/core": "5.2.9",
"@angular/forms": "5.2.9",
"@angular/http": "5.2.9",
"@angular/platform-browser": "5.2.9",
"@angular/platform-browser-dynamic": "5.2.9",
"@angular/platform-server": "5.2.9",
"@angular/router": "5.2.9",
"@ngtools/webpack": "6.0.0-rc.2.4",
"@types/chai": "4.1.2",
"@types/jasmine": "2.8.6",
"@types/webpack-env": "1.13.5",
"angular2-router-loader": "0.3.5",
"angular2-template-loader": "0.6.2",
"aspnet-prerendering": "^3.0.1",
"aspnet-webpack": "^2.0.3",
"awesome-typescript-loader": "5.0.0",
"bootstrap": "4.0.0",
"chai": "4.1.2",
"css": "2.2.1",
"css-loader": "0.28.11",
"es6-shim": "0.35.3",
"event-source-polyfill": "0.0.12",
"expose-loader": "0.7.5",
"extract-text-webpack-plugin": "3.0.2",
"file-loader": "1.1.11",
"html-loader": "0.5.5",
"isomorphic-fetch": "2.2.1",
"jasmine-core": "3.1.0",
"jquery": "3.3.1",
"json-loader": "0.5.7",
"karma": "2.0.0",
"karma-chai": "0.1.0",
"karma-chrome-launcher": "2.2.0",
"karma-cli": "1.0.1",
"karma-jasmine": "1.1.1",
"karma-webpack": "3.0.0",
"preboot": "6.0.0-beta.3",
"raw-loader": "0.5.1",
"reflect-metadata": "0.1.12",
"rxjs": "5.5.8",
"style-loader": "0.20.3",
"to-string-loader": "1.1.5",
"typescript": "2.8.1",
"url-loader": "1.0.1",
"webpack": "4.5.0",
"webpack-hot-middleware": "2.22.0",
"webpack-merge": "4.1.2",
"zone.js": "0.8.26"
}
}
Is there something missing or wrong?

I will need some time to check with that Angular version: sadly, as I stated on Chapter 1, upgrading the package is not an option if you're not willing to go through the various change logs and do the minor required steps to adapt the code to the new stuff.

Thank you for your answers.   Can you write me the right comands to upgrade both package.json file and npm dependencies  to the latest (stable) versions of packages.


[Question] Behaviour of SignIn card on Skype & other channels

System Information

SDK Language: Node.js
SDK Version: 3.8.3
Development Environment: Azure WebApp

Issue Description
The SignIn card has very different behaviour on different Skype version. At the moment it works the best on Skype for Mac (7.48), however on iOS it is broken. Same for Microsoft Teams, where I have built a workaround for.
My concern is; how can we use this kind of functionality if it isn't supported on all Skype apps (newest updates) and if it behaves different in all apps.
Code Example
    let card;
    if (session.message.source === 'msteams') {
       // Microsoft Teams
        card = new HeroCard(session)
            .title("Who are you?")
            .text("In order to use this bot, you have to login first with your Microsoft AD account.")
            .buttons([
                CardAction.openUrl(session, link, 'Sign In')
            ])
    } else {
       // Cortana + Skype
        card = new SigninCard(session)
            .text("In order to use this bot, you have to login first with your Microsoft AD account.")
            .button('Sign In', link)
    }

Steps to Reproduce

Create SigninCard
Open Skype / Microsoft Teams
Try to click the sign in button

Expected Behavior
Same experience on all apps of the same platform.
Actual Results
Skype for Mac (7.48) - works - screenshot
Skype  for Windows - works (but opens in IE)
Skype for Windows (classic, <IP_ADDRESS>) - works (but opens in IE)
Skype for iOS (<IP_ADDRESS>) - broken (button doesn't work) - [screenshot]
Cortana (iOS) - works
Cortana (Windows) - works

@iMicknl Using Skype iOS <IP_ADDRESS> on iOS v10.3.2 (14F89) - I am unable to duplicate the error.  I can tap the "Connect" button and it opens Safari mobile with MS sign-in page.

@nwhitmont strange, thanks for your reply. I will have a look again, however I was able to reproduce it on a colleague his device too. also iOS 10.3.2 (14F89)

@iMicknl Hmmm, well that is interesting...

iOS bug tracked via #2942 - closing


'required' hook

Currently the 'required' hook allows use with find/get but it should only work with update/patch as per eddystop here: https://github.com/feathers-plus/docs/issues/14  The docs also don't mention any such restrictions.

Hook is restricted to create, update patch.
Published in v4.5.2


Deploying managed node group with default user_data template fails - Ec2LaunchTemplateInvalidConfiguration: User data was not in the MIME multipart format.

Description
While trying to deploy a completely private EKS cluster,
when adding the enable_bootstrap_user_data = true option to add the necessary flags to the bootstrap.sh script the apply fails.
Versions

Terraform: 1.1.5

Provider(s): AWS 3.71.0

Module: 18.x

Reproduction

Steps to reproduce the behavior:

Create a managed node group EKS (platform linux)
Add the enable_bootstrap_user_data = true flag
Run plan

Code Snippet to Reproduce
eks_managed_node_groups = {
	  main_node_group = {
		    name = "***"

		    enable_monitoring      = false
		    create_launch_template = true
		    ebs_optimized          = true
		    desired_capacity       = 1
		    max_capacity           = 1
		    min_capacity           = 1

		    vpc_security_group_ids  = []

		    disk_size       = 100

		    instance_types = ["r5.xlarge"]
		    ami_type       = "AL2_x86_64" # "BOTTLEROCKET_ARM_64" "AL2_ARM_64"
		    public_ip      = false

		    # Bootstrap data
		    enable_bootstrap_user_data = true
	}
}

Expected behavior
Apply ran successfully

Actual behavior
╷
│ Error: error waiting for EKS Node Group (***) to create: unexpected state 'CREATE_FAILED', wanted target 'ACTIVE'. last error: 1 error occurred:
│ 	* : Ec2LaunchTemplateInvalidConfiguration: User data was not in the MIME multipart format.
│
│
│
│   with module.eks.module.eks.module.eks_managed_node_group["***"].aws_eks_node_group.this[0],
│   on .terraform/modules/eks.eks/modules/eks-managed-node-group/main.tf line 269, in resource "aws_eks_node_group" "this":
│  269: resource "aws_eks_node_group" "this" {
│
╵

Additional context
I think this is due to the _user_data module not using cloudinit_config when the enable_bootstrap_user_data is set.

the MIME multipart is only required when using EKS managed node groups and NOT supplying a custom AMI (i.e. - no value provided for ami_id)

@bryantbiggs
Well I don't have an ami_id here, I just supplied the ami_type which as I understand is not the same as supplying a custom AMI, please correct me if I'm wrong

ah my apologies, I mis-read ami_type and thought ami_id - the enable_bootstrap_user_data doesn't do anything in this case and isn't required in your config. why do you suggest the issue is with the MIME multipart user data (or user data at all)?

Well I have managed to deploy this exact configuration and managed node group and it works great without the enable_bootstrap_user_data, But here I must configure the EKS nodes with the bootstrap.sh script to use the CA and Endpoint flags for it to work in a private (no egress only VPCe) environment.

For Linux and Windows nodes, you must include bootstrap arguments when launching self-managed nodes. This text
bypasses the Amazon EKS introspection and doesn't require access to the Amazon EKS API from within the VPC. Replace  and  with the values from your Amazon EKS cluster.
For Linux nodes:

--apiserver-endpoint  --b64-cluster-ca
For additional arguments, see the bootstrap script
on GitHub.
For Windows nodes:
-APIServerEndpoint <api-server-endpoint> -Base64ClusterCA <certificate-authority>

For additional arguments, see [Amazon EKS optimized Windows AMI](https://docs.aws.amazon.com/eks/latest/userguide/eks-custom-ami-windows.html).


ValueError: Could not find CIFs in ...

What is your question?
The program raise this error all of a sudden. The problem pop up today and it ran quite well before.  I saw the similar issue here but I didn't see any new version released so I assume this is not the problem of my current version?
Computational environment

OS: centOS7
CUDA version if Linux 11.1.74

To be clearer, the current version I am using is:
Running colabfold 1.3.0 (f1b66cf202cee52d6a5c86cc4e8dd4ae1a048645)
I saw similar issue regarding the confusion version number but I assume the hash value can prove my current version is 1.4.0 :)
and more precisely, the error the program is raising is:
Running colabfold 1.3.0 (f1b66cf202cee52d6a5c86cc4e8dd4ae1a048645)
2022-10-16 09:32:00,649 --max-msa can not be used in combination with AlphaFold2-multimer (--max-msa ignored)
WARNING: You are welcome to use the default MSA server, however keep in mind that it's a limited shared resource only capable of processing a few thousand MSAs per day. Please submit jobs only from a single IP address. We reserve the right to limit access to the server case-by-case when usage exceeds fair use.
If you require more MSAs:

You can precompute all MSAs with colabfold_search or

You can host your own API and pass it to --host-url
2022-10-16 09:32:02,346 Found 8 citations for tools or databases
2022-10-16 09:32:06,077 Query 1/1: AA2AR_Nb.AD101 (length 534)
COMPLETE: 100%|██████████████████████| 300/300 [elapsed: 00:05 remaining: 00:00]

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
cp: cannot stat ‘/home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101/pdb70_a3m.ffindex’: No such file or directory
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
cp: cannot stat ‘/home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_102/pdb70_a3m.ffindex’: No such file or directory
2022-10-16 09:32:12,472 Could not find CIFs in /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101
2022-10-16 09:32:12,473 Could not get MSA/templates for AA2AR_Nb.AD101: Could not find CIFs in /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101
Traceback (most recent call last):
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 1341, in run
host_url,
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 790, in get_msa_and_templates
query_seqs_unique[index],
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 158, in mk_template
obsolete_pdbs_path=None,
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/alphafold/data/templates.py", line 828, in init
raise ValueError(f'Could not find CIFs in {self._mmcif_dir}')
ValueError: Could not find CIFs in /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101
2022-10-16 09:32:12,474 Done
And I have never encountered this error before(I have been using it for a while) Plus, other input files that have been successfully calculated before also failed when I try to re-run it today.
Thanks a lot in advance for reviewing my issue!

I've never encountered such an issue. Why don't you delete the colabfold_batch directory and reinstall it?

Thanks for your kind response! I have tried re-install it just now. However, the problem is still there and the same error is raised.
colabfold_batch --amber --templates --num-recycle 3 --use-gpu-relax '/home/Pan_lab/Desktop/inputfile.fasta' /home/Pan_lab/Desktop/ZXD_3
2022-10-17 03:14:28,332 Running colabfold 1.3.0 (cc434cd7e93d9c6034c2fe8e7b92ba4cce3c8268)
2022-10-17 03:14:29,432 --max-msa can not be used in combination with AlphaFold2-multimer (--max-msa ignored)
Downloading alphafold2 weights to /home/Pan_lab/colabfold_batch/colabfold: 100%|
WARNING: You are welcome to use the default MSA server, however keep in mind that it's a limited shared resource only capable of processing a few thousand MSAs per day. Please submit jobs only from a single IP address. We reserve the right to limit access to the server case-by-case when usage exceeds fair use.
If you require more MSAs:

You can precompute all MSAs with colabfold_search or

You can host your own API and pass it to --host-url
Fontconfig error: Cannot load default config file: No such file: (null)
2022-10-17 03:25:47,228 Could not open font file /usr/share/fonts/google-noto-emoji/NotoColorEmoji.ttf: In FT2Font: Can not load face.  Unknown file format.
2022-10-17 03:25:47,613 generated new fontManager
2022-10-17 03:25:49,140 Found 8 citations for tools or databases
2022-10-17 03:25:52,709 Query 1/1: AA2AR_Nb.AD101 (length 534)
COMPLETE: 100%|██████████████████████| 300/300 [elapsed: 00:05 remaining: 00:00]

gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
cp: cannot stat ‘/home/Pan_lab/Desktop/ZXD_3/AA2AR_Nb.AD101_env/templates_101/pdb70_a3m.ffindex’: No such file or directory
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
cp: cannot stat ‘/home/Pan_lab/Desktop/ZXD_3/AA2AR_Nb.AD101_env/templates_102/pdb70_a3m.ffindex’: No such file or directory
2022-10-17 03:25:58,447 Could not find CIFs in /home/Pan_lab/Desktop/ZXD_3/AA2AR_Nb.AD101_env/templates_101
2022-10-17 03:25:58,448 Could not get MSA/templates for AA2AR_Nb.AD101: Could not find CIFs in /home/Pan_lab/Desktop/ZXD_3/AA2AR_Nb.AD101_env/templates_101
Traceback (most recent call last):
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 1341, in run
host_url,
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 790, in get_msa_and_templates
query_seqs_unique[index],
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/colabfold/batch.py", line 158, in mk_template
obsolete_pdbs_path=None,
File "/home/Pan_lab/colabfold_batch/colabfold-conda/lib/python3.7/site-packages/alphafold/data/templates.py", line 828, in init
raise ValueError(f'Could not find CIFs in {self._mmcif_dir}')
ValueError: Could not find CIFs in /home/Pan_lab/Desktop/ZXD_3/AA2AR_Nb.AD101_env/templates_101
2022-10-17 03:25:58,449 Done

gzip: stdin: unexpected end of file
tar: Child returned status 1

One possible cause is that the downloaded mmCIF files in /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101 maybe broken for some reason when it was taken from the Internet. And, the error occurs unless removing the output directory. So try to remove the /home/Pan_lab/Desktop/ZXD_1 directory and re-run it.
And I have never encountered this error before(I have been using it for a while) Plus, other input files that have been successfully calculated before also failed when I try to re-run it today.

But, it would be very strange if indeed all your calculations cause a similar error. It is not very likely, but possible that gzip or gunzip command itself, which decompresses gzip and tar, may be corrupted...?

Ah, please show me the list of directory of /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101 before removing it.
$ ls -lt /home/Pan_lab/Desktop/ZXD_1/AA2AR_Nb.AD101_env/templates_101

There is only a ffdata file in this directory.

well there is only a ffdata file in this directory.
[root@localhost templates_101]# ls
pdb70_cs219.ffdata
[root@localhost templates_101]# ls -lt
total 0
-rw-r--r--. 1 root root 0 Oct 17 05:21 pdb70_cs219.ffdata
[root@localhost templates_101]#

I tried to remove and re-run it but it doesn't work.
Indeed, all of my calculations raise the same error...

Can you decompress .cif.gz files? For example,
$ wget https://files.rcsb.org/download/1ALK.cif.gz
$ gunzip 1ALK.cif.gz

Show me the full output log after removing the output directory if exists:
$ colabfold_batch --amber --templates --num-recycle 3 --use-gpu-relax '/home/Pan_lab/Desktop/inputfile.fasta' /home/Pan_lab/Desktop/ZXD_3

2022-10-17 19:13:53,348 Running colabfold 1.3.0 (22671664ac2c9dcb30086c3e654414d950ccb297)
WARNING: You are welcome to use the default MSA server, however keep in mind that it's a limited shared resource only capable of processing a few thousand MSAs per day. Please submit jobs only from a single IP address. We reserve the right to limit access to the server case-by-case when usage exceeds fair use.

If you require more MSAs:

* You can precompute all MSAs with `colabfold_search` or

* You can host your own API and pass it to `--host-url`
2022-10-17 19:13:55,323 Found 8 citations for tools or databases
2022-10-17 19:13:57,736 Query 1/1: Foobar (length 47)
COMPLETE: 100%|█████| 150/150 [elapsed: 00:01 remaining: 00:00]
2022-10-17 19:14:05,481 Sequence 0 found templates: ['3poy_A', '3poy_A', '3qcw_A', '3qcw_A', '4xbm_A', '4xbm_B', '5fm9_A', '5fma_A', '4d90_A', '4d90_B', '4xbm_B', '4d90_A', '4d90_B']
2022-10-17 19:14:05,541 Running model_1

I do can decompress those files and gunzip works fine. For your second demand, I don't quite understand you. Are you asking for:
[root@localhost Desktop]# colabfold_batch --amber --templates --num-recycle 3 --use-gpu-relax '/home/Pan_lab/Desktop/inputfile.fasta'
usage: colabfold_batch [-h] [--stop-at-score STOP_AT_SCORE]
[--stop-at-score-below STOP_AT_SCORE_BELOW]
[--num-recycle NUM_RECYCLE]
[--num-ensemble NUM_ENSEMBLE]
[--random-seed RANDOM_SEED] [--num-models {1,2,3,4,5}]
[--recompile-padding RECOMPILE_PADDING]
[--model-order MODEL_ORDER] [--host-url HOST_URL]
[--data DATA]
[--msa-mode {MMseqs2 UniRef+Environmental),MMseqs2 (UniRef only,single_sequence}]
[--model-type {auto,AlphaFold2-ptm,AlphaFold2-multimer-v1,AlphaFold2-multimer-v2}]
[--amber] [--templates]
[--custom-template-path CUSTOM_TEMPLATE_PATH] [--env]
[--cpu] [--rank {auto,plddt,ptmscore,multimer}]
[--pair-mode {unpaired,paired,unpaired+paired}]
[--recompile-all-models]
[--sort-queries-by {none,length,random}]
[--save-single-representations]
[--save-pair-representations] [--training]
[--max-msa {512:5120,512:1024,256:512,128:256,64:128,32:64,16:32}]
[--zip] [--use-gpu-relax]
[--overwrite-existing-results]
input results
colabfold_batch: error: the following arguments are required: results
or just the rm - rf command?(This does not have an output)
(run the command you wrote above gives exactly the same error)

An update: I found that when I run the sequences that do not have a template(those that the msa server cannot find template, it runs normally:
colabfold_batch --amber --templates --num-recycle 3 --use-gpu-relax '/home/Pan_lab/Desktop/outputfiles/kinesin.fasta' ./GXY
2022-10-17 07:48:40,038 Running colabfold 1.3.0 (cc434cd7e93d9c6034c2fe8e7b92ba4cce3c8268)
2022-10-17 07:48:41,040 --max-msa can not be used in combination with AlphaFold2-multimer (--max-msa ignored)
WARNING: You are welcome to use the default MSA server, however keep in mind that it's a limited shared resource only capable of processing a few thousand MSAs per day. Please submit jobs only from a single IP address. We reserve the right to limit access to the server case-by-case when usage exceeds fair use.
If you require more MSAs:

You can precompute all MSAs with colabfold_search or

You can host your own API and pass it to --host-url
2022-10-17 07:48:42,786 Found 8 citations for tools or databases
2022-10-17 07:48:46,387 Query 1/1: kinesin (length 594)
COMPLETE: 100%|█████████████████████████| 300/300 [elapsed: 00:01 remaining: 00:00]
2022-10-17 07:48:47,435 Sequence 0 found no templates
2022-10-17 07:48:47,436 Sequence 1 found no templates
COMPLETE: 100%|█████████████████████████| 300/300 [elapsed: 00:00 remaining: 00:00]
2022-10-17 07:48:48,537 Running model_3

Yes, I wanted to know if the issue occurs when the templates were found or not.
I checked the colabfold.py and found a minimal test for this case. Try the command and check the result:
$ mkdir ./testdownload
$ curl -s -L https://api.colabfold.com/template/1ALK_A | tar xzf - -C ./testdownload/
$ ls -l ./testdownload
total 660
-rw-rw-r-- 1 moriwaki moriwaki 672013 Oct 18 00:35 1alk.cif
-rw-rw-r-- 1 moriwaki moriwaki      0 Oct 18 00:35 pdb70_a3m.ffdata
-rw-rw-r-- 1 moriwaki moriwaki      0 Oct 18 00:35 pdb70_a3m.ffindex

wow I think the problem is here!
The output is as follows:
(And honestly the original environment variable for curl is not this but I don't remember the original address)
[root@localhost Pan_lab]# cd Desktop/
[root@localhost Desktop]# mkdir ./testdownload
[root@localhost Desktop]# curl -s -L https://api.colabfold.com/template/1ALK_A | tar xzf - -C ./testdownload/
gzip: stdin: unexpected end of file
tar: Child returned status 1
tar: Error is not recoverable: exiting now
[root@localhost Desktop]# which curl
/home/Pan_lab/Downloads/pymol/bin/curl
[root@localhost Desktop]# cd ./testdownload/
[root@localhost testdownload]# ll
total 0

Oh when I move this curl away then the default curl recovered! I think the issue has been solved! Thank you very much! ありがとうございました！


S port scale fix

Fixed some issues on FrSky S.Port telemetry

Fixed scaling on GPS coords and Altitude
Fixed heading data
Correctly formatted GPS date/time information

Tested on a Pixracer with Taranis+

@fredmcc can you rebase? I think that should clean up the build failure.

@dagar rebased and now builds ok.

Sorry for the latency on this - it fell through the cracks. I'm merging now as is, but there is room for optimization. Are you interested in polishing the S.Port output further? If yes, I would like to encourage you to participate on the dev calls so we can pair you with someone with more system context:
https://dev.px4.io/en/contribute/#weekly-dev-call


need to either add the instance to a public subnet or set up a NAT Gateway.

unable to install AWS CLI on the instance, and even after installing AWS CLI using yum, I am unable to access Route 53.
Is there any other solution?

Hi @kr1json ,
Thanks for reaching out.
Did the Terraform deployment succeed?
Which part of the code failed?
On which instance are you trying to access AWS Route 53?

Hi @abdullahkhawer
That's correct. I resolved the issue by adding a NAT Gateway. I mentioned it because it wasn't included in the README.
Thank you for sharing such great code.
In the terraform-usage-example.tf example, t3.small is 2048, but why did you allocate 1648 CPU for the task? Is there any reason why 2048 couldn’t be allocated, or are there any considerations to keep in mind when doing so?

Hi @abdullahkhawer
That's correct. I resolved the issue by adding a NAT Gateway. I mentioned it because it wasn't included in the README.
Thank you for sharing such great code.
In the terraform-usage-example.tf example, t3.small is 2048, but why did you allocate 1648 CPU for the task? Is there any reason why 2048 couldn’t be allocated, or are there any considerations to keep in mind when doing so?

That's correct. I resolved the issue by adding a NAT Gateway.

@kr1json , Glad to hear that your issue is resolved.

I mentioned it because it wasn't included in the README.

Thanks for highlighting that though.
I have updated the prerequisites section in the README and mentioned NAT gateway in it.

Thank you for sharing such great code.

Welcome, the pleasure is all mine.
The purpose was to help others who wanted to do the same.

In the terraform-usage-example.tf example, t3.small is 2048, but why did you allocate 1648 CPU for the task? Is there any reason why 2048 couldn’t be allocated, or are there any considerations to keep in mind when doing so?

AWS ECS task uses "CPU units" to manage processing power, with 1024 units equal to 1 vCPU. A t3.small instance provides 2048 CPU units (2 vCPUs). Assigning all 2048 units to a task uses the instance’s full capacity, leaving no room for system or background processes, which may lead to throttling. To avoid this, I set it to a lower value which is 1648, to reserve some capacity (e.g., 400 units) for smoother operation and better system performance.
So, that is the reasoning behind that but you can set the instance type, CPU and memory to any desired values.
Is there anything else I can help you with?

Thank you for your help. Thanks to your code, I was able to set up MongoDB easily and quickly.

Welcome. 🙂


Local voices

Is there a way to use local voices with this package? I have personally trained onnx files that I would prefer to use over pipers models.

Interesting! I have been thinking about such an implementation lately. Apparently, as you can observe, text-to-speech models, unlike most generative models, aren’t just tokenized text in, tokenized text out. Even in harmonized platforms such as Hugging Face, some of the most popular models, namely XTTS-v2 from Coqui and parler_tts_mini_v0.1 from Parler-TTS, differ in their architecture and lack a proper config.json. This is crucial for the pipeline (which is sort of a universal adaptor that takes an input and spits out a NumPy array of the audio) to work. In addition to that, Piper from Rhasspy uses an entirely different approach where the texts are phenomized before being fed into the corresponding process. Certainly, this diversity of approaches to process text-to-speech decreases the probability and makes it difficult to create a sort of implementation that goes about different models.
Generally these are my assumption
I would like to know what you think and if there's work around for the problem.

So the voice files I have trained were trained and built using piper. they contain the correct json config files. as far as ones trained with other software I'm unsure.

In that case it should work. Great feature request! Consideration for inclusion of the fix in the upcoming release is underway. Should there be interest in self-implementation, contributions via PR are always welcomed!


[SPARK-37099][SQL][FOLLOWUP] Add numOutputRows metric for WindowGroupLimitExec

What changes were proposed in this pull request?

Add numOutputRows metric in WindowGroupLimitExec
Why are the changes needed?

WindowGroupLimitExec  is a kind of filter that would drop unused rows in each window group, so numOutputRows could help user find if it has benefits.
Does this PR introduce any user-facing change?

no
How was this patch tested?

add test

cc @beliefer @cloud-fan

@ulysses-you Thank you for ping me.
Should we put numOutputRows += 1 into BaseLimitIterator.next() ?

yea, I'm fine move it to iterator. jsut want to make less change, though.

the failed pyspark test seems irrelevant..

thanks, merging to master!

LGTM.


Implement more flows ops methods part 2

Closes #67

I assume these are directly translated from ox - any places where the implementations diverge?

I assume these are directly translated from ox - any places where the implementations diverge?

Yes, all of them are translated, including tests (I rely on them to see if implementation works).
One additional thing is that for methods that use Scope.unsupervised or Scope.supervised I need to catch ExecutionException and rethrow it for the tests to pass. See: https://github.com/softwaremill/jox/pull/75/files#diff-46d2537d747d24775cf70630d584ac42326ea6902d3ddd10f5a861841c2c3b6cR738

One additional thing is that for methods that use Scope.unsupervised or Scope.supervised I need to catch ExecutionException and rethrow cause for the tests to pass. See: https://github.com/softwaremill/jox/pull/75/files#diff-46d2537d747d24775cf70630d584ac42326ea6902d3ddd10f5a861841c2c3b6cR738

Are these tests which verify what exception was thrown? Maybe we could instead change the tests to verify that an EE was thrown?
EE are something that we might want to change in general (see https://github.com/softwaremill/jox/issues/59), but until then, it would be good to keep consistency.

One additional thing is that for methods that use Scope.unsupervised or Scope.supervised I need to catch ExecutionException and rethrow cause for the tests to pass. See: https://github.com/softwaremill/jox/pull/75/files#diff-46d2537d747d24775cf70630d584ac42326ea6902d3ddd10f5a861841c2c3b6cR738

Are these tests which verify what exception was thrown? Maybe we could instead change the tests to verify that an EE was thrown?
EE are something that we might want to change in general (see #59), but until then, it would be good to keep consistency.

Yes, those are the tests that verify it. I can fix the tests and verify that EE is thrown. Overall those exceptions are ugly as we are adding 2/3 wrappers on top of source exception in most cases

@uini223 let's get rid of them in a separate issue then :)

@uini223 let's get rid of them in a separate issue then :)

Removed all rethrows that were present in the code I've added recently


Use trait methods

This is yet another iteration on the trait method approach. I spent some time getting the last approach working with arbitrary extensions.
With this pattern, implementing requests with extensions is pretty lightweight as you can lean on ::new() from the related request type as well as those structs.

@masalachai We have a need for this soon so I want to keep moving forward with migrating the rest of the existing request types. I wanted to let you know in case you have some work in this in progress.

@masalachai I really liked your approach of dynamically setting the extension and I also like the use of trait methods that @djc introduced so I tried to take a hybrid approach. What are you thoughts on this?
Domain check looks like:
https://github.com/masalachai/epp-client/pull/21/files#diff-ef2cbb3cddea76fafbddd0ac6be8e4bf9b3a3078c386b2f962b3cbd736d1adf8
An extension looks like this:
https://github.com/masalachai/epp-client/pull/21/files#diff-8990931e4dba86da84cc70b045661f05f020b5070c5db72a5648744ae5c271a7
The caller looks ilke this:
https://github.com/masalachai/epp-client/pull/21/files#diff-ba88195ca335e8fdfb36a849d5ed9cada3801a255e0c45bcb9ca1e1e55b529d0

Hi @nrempel ,
I think this looks really nice and neat with the response types also accounted for. I would be happy to proceed with reorganizing the types this way.

Hi @nrempel ,
I think this looks really nice and neat with the response types also accounted for. I would be happy to proceed with reorganizing the types this way.

Great! I'll work on implementing this pattern.

If you need help with it we can work on it in a new branch separate from main.

If you need help with it we can work on it in a new branch separate from main.

Thanks! I've started working on this in a branch here: https://github.com/nrempel/epp-client/tree/nrempel/trait-method-extensions
I've almost finished migrating the domain messages to the new pattern. If you feel like taking on host or contact, please feel free!
A good workflow might be to make a PR into that branch for changes, then I can PR back into the main repo?
I won't have much time to work on this over the weekend but I hope to come back and wrap this up on Monday.

Closing this as I am continuing work in a fresh branch.


[SC] StartService FAILED 3:  The system cannot find the path specified.

sc start EbpfCore
[SC] StartService FAILED 3:
The system cannot find the path specified.
sc start NetEbpfExt
[SC] StartService FAILED 3:
The system cannot find the path specified.

Issue #248 might also help with this once that is resolved, unsure.

@TylerJaacks did you build for Debug or Release?   And on what version of Windows did you try this?

@TylerJaacks  - please send the output to:
(Get-ItemProperty "HKLM:\Software\Microsoft\Windows NT\CurrentVersion").BuildLabEx

@TylerJaacks we have not been able to repro this.  If you can get a repro, please Reopen and provide the above info.

@shankarseal 19041.1.amd64fre.vb_release.191206-1406


Add placeholder for showcase functional test suite

This adds a new project for the showcase conformance tests that will be added for each generator.
Note that this is just the scaffolding. The placeholder test currently fails and invoking the generator is currently failing with:
/Users/jbolinger/Development/gapic-generator-ruby/gapic-generator/lib/google/gapic/runner.rb:37:in `run': uninitialized constant Google::Gapic::Schema (NameError)
	from /Users/jbolinger/Development/gapic-generator-ruby/gapic-generator/bin/protoc-gen-ruby_gapic:24:in `<top (required)>'
	from /Users/jbolinger/.rvm/gems/ruby-2.4.1/bin/protoc-gen-ruby_gapic:23:in `load'
	from /Users/jbolinger/.rvm/gems/ruby-2.4.1/bin/protoc-gen-ruby_gapic:23:in `<main>'
--ruby_gapic_out: protoc-gen-ruby_gapic: Plugin failed with status code 1.

I will update these tests as soon as the generator is capable of generating a functional client.
Also, let me know what you think of using docker locally for the tests. I thought this would be a handy way to do it but you may have better ideas. I'll also need to add something so it doesn't try to start the server this way in CI once we have that setup.

This is good to merge. PTAL.

Thanks for updating this!
We only need the echo client for now, but putting them all in here as you've done is fine so long as you're okay with a the small amount of extra churn it might create by putting them all in place now.
(I can't approve since I started it though)

@jbolinger I approved this yesterday, do you want to merge?

Oh, sorry about that @quartzmo - thanks for the reminder.